…ng (elastic#557)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#564)

Co-authored-by: apmmachine <[email protected]>

Fix regression from elastic#509

…ng (elastic#573)

Co-authored-by: apmmachine <[email protected]>

…eams (elastic#527)

These 2 value are going to be used in the shipper to identify where an
event came from in order to apply processors accordingly.

Also, added test cases for the processor to verify the change and updated test cases with the new processor.

…#570)

* Add filemod times to contents of diagnostics collect command

Add filemod times to the files and directories in the zip archive.
Log files (and sub dirs) will use the modtime returned by the fileinfo
for the source. Others will use the timestamp from when the zip is
created.

* Fix linter

…ng (elastic#581)

Co-authored-by: apmmachine <[email protected]>

* Fix Agent upgrade 8.2->8.3
* Improve the upgrade encryption handling. Add .yml files cleanup.
* Rollback ActionUpgrade to action_id, add MarkerActionUpgrade adapter struct for marker serialization compatibility

…ng (elastic#591)

Co-authored-by: apmmachine <[email protected]>

* Set explicit ExitTimeOut for MacOS agent launchd plist

…ng (elastic#599)

Co-authored-by: apmmachine <[email protected]>

…d, liveness endpoint added (elastic#569)

* Add liveness endpoint

Add /liveness route to metrics server. This route will report the status
from pkg/core/status. fleet-gateway will now report a degraded state if
a checkin fails. This may not propogate to fleet-server as a failed
checkin means communications between the agent and the server are not
working. It may also lead to the server reporting degraded for up to 30s
(fleet-server polling time) when teh agent is able to successfully
connect.

* linter fix

* add nolint direcrtive

* Linter fix

* Review feedback, add doc strings

* Rename noop controller file to _test file

…ng (elastic#607)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#620)

Co-authored-by: apmmachine <[email protected]>

)

…ng (elastic#631)

Co-authored-by: apmmachine <[email protected]>

…tic#458)

* Set hostPID=true for managed agent in k8s

* Add comment on hostPID.

…ng (elastic#648)

Co-authored-by: apmmachine <[email protected]>

…rificationMode to `full` (elastic#521)

* update version

* mage fmt update

* update dependency

* update changelog

)

* support input type with regex

* Update supported.go

* Changing the regex to support backward compatible

…ng (elastic#656)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#661)

Co-authored-by: apmmachine <[email protected]>

cosmetic change in the description and boolean based

…ng (elastic#668)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#675)

Co-authored-by: apmmachine <[email protected]>

…stic#674)

…ng (elastic#684)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#703)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#705)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#713)

Co-authored-by: apmmachine <[email protected]>

* fix to allow dashes in variable names in EQL expressions

extend eql to allow the '-' char to appear in variable names, i.e.,
${data.some-var} and additional test cases to eql, the transpiler, and
the k8s provider to verify this works. Note that the bug was caused by
the EQL limitation, the otehr test cases were added when attempting to
find it.

* Regenerate grammer with antlr 4.7.1, add CHANGELOG

* Fix linter issue

* Fix typo

Fix transpiler regex to allow ':' characters in dynamic variables so
that users can input "${dynamic.lookup|'fallback.here'}".

Co-authored-by: Aleksandr Maus <[email protected]>

)

* Reproduce filebeat picking up packetbeat inputs

* Filebeat: filter inputs as first input transform.

Move input filtering to be the first input transformation that occurs in
the filebeat spec file. Fixes
elastic#427.

* Update changelog.

…ng (elastic#724)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#727)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#732)

Co-authored-by: apmmachine <[email protected]>

This commit fixes the typo in the package command on the README.md.

* Allow the / character to be used in variable names.

Allow / to be used in variable names from dynamic providers and eql
expressions. Ensure that k8s providers can provide variables with
slashes in their names.

* run antlr4

* Fix tests

…astic#701)

* Fix Elastic Agent non-fleet broken upgrade between 8.3.x releases

* Migrates vault directory on linux and windows to the top directory of the
  agent, so it can be shared without needing the upgrade handler call,
  like for example with side-by-side install/upgrade from .rpm/.deb
* Extended vault to allow read-only open, useful when the vault at particular location needs to be only read not created.

* Correct the typo in the log messages

* Update lint flagged function comment with 'unused', was flagged with 'deadcode' on the previous run

* Address code review feedback

* Add missing import for linux utz

* Change vault path from Top() to Config(), this a better location, next to fleet.enc based on the install/upgrade testing with .rpm/.deb installs

* Fix the missing state migration for .rpm/.deb upgrade. The post install script now performs the migration and creates the symlink after that.

* Fix typo in the postinstall script

* Update the vault migration code, add the agent configuration match check with the agent secret

…ng (elastic#746)

Co-authored-by: apmmachine <[email protected]>

Adding M1 variable to export to be able to build AMD images

This commit add unique IDs for the filestream inputs used by the
Kubernetes integration in the Elastic-Agent standalone
Kubernetes configuration/manifest file.

Alter the linter action to run on different OSs instead of on linux with
the $GOOS env var.

…ng (elastic#771)

Co-authored-by: apmmachine <[email protected]>

…owner for the k8s manifests (elastic#708)

* managed elastic-agent: add comments; add cloudnative team as a codeowner for the k8s manifests

Signed-off-by: Tetiana Kravchenko <[email protected]>

* add comments to the standalone elastic-agent, similar to the documentation we have https://www.elastic.co/guide/en/fleet/current/running-on-kubernetes-standalone.html

Signed-off-by: Tetiana Kravchenko <[email protected]>

* Apply suggestions from code review

Co-authored-by: Michael Katsoulis <[email protected]>
Co-authored-by: Andrew Gizas <[email protected]>

* remove comment for FLEET_ENROLLMENT_TOKEN; use Needed everywhere instead of Required

Signed-off-by: Tetiana Kravchenko <[email protected]>

* rephrase regarding accessing kube-state-metrics when used third party tools, like kube-rbac-proxy

Signed-off-by: Tetiana Kravchenko <[email protected]>

* run make check

Signed-off-by: Tetiana Kravchenko <[email protected]>

* keep manifests in sync to pass ci check

Signed-off-by: Tetiana Kravchenko <[email protected]>

* add info on where to find FLEET_URL and FLEET_ENROLLMENT_TOKEN

Signed-off-by: Tetiana Kravchenko <[email protected]>

* add links to elastic-agent documentation

Signed-off-by: Tetiana Kravchenko <[email protected]>

* update comment on FLEET_ENROLLMENT_TOKEN

Signed-off-by: Tetiana Kravchenko <[email protected]>

Co-authored-by: Michael Katsoulis <[email protected]>
Co-authored-by: Andrew Gizas <[email protected]>

* Update will cleanup unneeded artifacts.

The update process will cleanup unneeded artifacts. When an update
starts all artifacts that do not have the current version number in it's
name will be removed. If artifact retrieval fails, downloaded artifacts
are removed. On a successful upgrade, all contents of the downloads dir
will be removed.

* Clean up linter warnings

* Wrap errors

* cleanup tests

* Fix passed version

* Use os.RemoveAll

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#799)

Co-authored-by: apmmachine <[email protected]>

…ic#802)

Signed-off-by: Florian Lehner <[email protected]>

Fix unpacking of artifact config (elastic#776)

…ng (elastic#826)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#833)

Co-authored-by: apmmachine <[email protected]>

* Fix RPM/DEB clean install

* Improve the post install script

* Do not try to copy the state files if the agent directory is the same,
  this causes the error.
* Check the existance of symlink instead of the file it is pointing to
  for the state file migration.

* Update check for symlink existance for the cases where the symlink points to non-existent file

Signed-off-by: Florian Lehner <[email protected]>

Reload downloader client on config change (elastic#848)

…elastic#714)

* Bundle elastic-agent.app for MacOS, needed to be able to enable the  Full Disk Access

* Calm down the linter

* Fix pathing for windows unit test

Signed-off-by: Florian Lehner <[email protected]>

…tic#764)

This is the agent counterpart to elastic/beats#32122

Refactors Dockerfile handling of synthetics deps to rely on playwright install-deps rather than us manually keeping up to date with those. This should fix issues with newer playwrights needing additional deps.

This also cleans up the Dockerfile a good amount, and fixes indentation. Finally, this removes the unused Dockerfile.elastic-agent.tmpl file since agent is now its own repo. It also cleans up some other metadata that no longer does anything.

No changelog is specified because no user facing changes are present.

…ng (elastic#889)

Co-authored-by: apmmachine <[email protected]>

* Fix a panic with wg passed to the composable object

In the code to retrieve the variables from the configuration files we
need to pass a execution callback, this callback will be called in a
goroutine. This callback can be executed multiple time until the
composable renderer is stopped. There were a problem in the code that
made the callback called multiple time and it made the waitgroup
internal counter to do to a negative values.

This commit change the behavior, it start the composable renderer give
it a callback when the callback receives the variables it will stop the
composable's Run method using the context.

This ensure that the callback will be called a single time and that the
variables are correctly retrieved.

Fixes: elastic#806

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#899)

Co-authored-by: apmmachine <[email protected]>

* Add toleration to elastic-agent Kubernetes manifests.

The toleration with key node-role.kubernetes.io/control-plane is set to replace
the deprecated toleration with key node-role.kubernetes.io/master which will be
removed by Kubernetes v1.25

* Remove outdated "master" node terminology.

This commit provides the relevant Jenkins CI automation to open Pull requests to kibana github repository in order to keep Cloud-Native teams manifests in sync with the manifests that are used into Fleet UI.

For full information check elastic#706

Updated .ci/Jenkins file that is triggered upon PR requests of /elastic-agent/deploy/kubernetes/* changes
Updated Makefile to add functionality needed to create the extra files for the new prs to kibana remote repository

* Reduce memory footprint by reordering struct elements

* rename struct element for linter

Signed-off-by: Florian Lehner <[email protected]>

Signed-off-by: Florian Lehner <[email protected]>

…ng (elastic#948)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#963)

Co-authored-by: apmmachine <[email protected]>

Make the lumberjack input available from Agent.

Relates: elastic/beats#32175

…ng (elastic#978)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#988)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#1004)

Co-authored-by: apmmachine <[email protected]>

…ng (elastic#1014)

Co-authored-by: apmmachine <[email protected]>