Skip to content

feat: Automatic layer releases #421

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 45 commits into from
Mar 4, 2024
Merged

feat: Automatic layer releases #421

merged 45 commits into from
Mar 4, 2024

Conversation

astuyve
Copy link
Contributor

@astuyve astuyve commented Feb 28, 2024 •
edited
Loading

What does this PR do?

This ports our entire CI environment to GitLab.

Motivation

Now we can do automated releases.

Testing Guidelines

Additional Notes

Types of Changes

  • Bug fix
  • New feature
  • Breaking change
  • Misc (docs, refactoring, dependency upgrade, etc.)

Check all that apply

  • This PR's description is comprehensive
  • This PR contains breaking changes that are documented in the description
  • This PR introduces new APIs or parameters that are documented and unlikely to change in the foreseeable future
  • This PR impacts documentation, and it has been updated (or a ticket has been logged)
  • This PR's changes are covered by the automated tests
  • This PR collects user input/sensitive content into Datadog
  • This PR passes the integration tests (ask a Datadog member to run the tests)

@astuyve astuyve requested a review from a team as a code owner February 28, 2024 20:53
astuyve added 27 commits February 29, 2024 14:33
@astuyve
feat: first crack at migration the build script for individual publis…
13a3dd1 
…hing
@astuyve
feat: secrets for python. TODO - actually create them
9c75e09
@astuyve
feat: Add python runtimes
6df517e
@astuyve
feat: re-organize architecture flags. Support separate arch/name
e79dce6
@astuyve
feat: first draft of build generator template
a8e3a7b
@astuyve
feat: Add datasources and first cut at publish_pypi script
ebd1a19
@astuyve
feat: oops, no node. TODO: fix container names
38325c3
@astuyve
feat: pass the right layer name to sign layers
bd275aa
@astuyve
feat: Python before script
032ba8b
@astuyve
feat: arch parameterized sign layer
c7757fc
@astuyve
feat: fix up runtimes
8223bcd
@astuyve
fix: build layer arch
74ef778
@astuyve
fix: Check layer size arch
2e6bab1
@astuyve
feat: zip file is py not python
f162f1d
@astuyve
fix: fix up check layer size script
2d74327
@astuyve
hotfix: use js ssm secrets until I can figure out which AWS account C…
d73ffb5 
…I runs in and can add them
@astuyve
feat: Less uniformity on images in python, specify in runtimes.yaml
9a0a1d8
@astuyve
feat: Can't use permissions across repos
8c8aad8
@astuyve
feat: lol our ci runners set DD_SERVICE so it breaks our unit tests
3a1f8de
@astuyve
feat: Gotta add yarn so we can add serverless
e981cf7
@astuyve
feat: lint
d770904
@astuyve
feat: Break install-node into separate task
05e81c5
@astuyve
feat: Use name instead of python_version
748865d
@astuyve
fix: no python-, just the version number
43dec9f
@astuyve
empty commit to bump CI
57603c1
@astuyve
feat: integration tests should run for both architectures
bd0132e
@astuyve
fix: arg, no arch in integration test
34ca5d7
joeyzhao2018
joeyzhao2018 approved these changes Mar 4, 2024
View reviewed changes
Copy link
Contributor

@joeyzhao2018 joeyzhao2018 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@astuyve astuyve changed the title feat: Copy gitlab-ci from datadog-lambda-js feat: Automatic layer releases Mar 4, 2024
astuyve
astuyve commented Mar 4, 2024
View reviewed changes
scripts/check_layer_size.sh
@@ -14,26 +14,22 @@ MAX_LAYER_UNCOMPRESSED_SIZE_KB=$(expr 24 \* 1024)

LAYER_FILES_PREFIX="datadog_lambda_py"
LAYER_DIR=".layers"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This check now only lives in gitlab and doesn't need to be ran once for all versions.

@astuyve astuyve merged commit 1649656 into main Mar 4, 2024
@astuyve astuyve deleted the aj/add-gitlab-config branch March 4, 2024 18:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@joeyzhao2018 joeyzhao2018 joeyzhao2018 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@astuyve @joeyzhao2018