Commit Graph

9 Commits

Author SHA1 Message Date
Brenden Matthews
a28af779d2
Add S3 cache download validation and retry logic
- Add empty file validation (0 bytes) and minimum size checks (512 bytes) for tar archives
- Implement download completeness validation (bytes downloaded = expected)
- Add retry logic with exponential backoff for validation failures (3 attempts: 1s/2s/4s delays)
- Create DownloadValidationError class for specific validation failures
- Add comprehensive test coverage for validation scenarios
- Maintain graceful degradation - validation failures log warnings but don't fail workflows
2025-06-20 16:35:40 -04:00
Brenden Matthews
7994cabd39
Add support for S3 endpoints 2025-03-11 13:29:31 -04:00
Cyril Rohr
cf6e7f2371 Allow to use existing AWS credentials even on RunsOn, by setting RUNS_ON_RUNNER_NAME="" 2024-05-21 16:52:36 +00:00
Oleksandr Prypkhan
148157c8d6 fix: Check for explicit true string 2024-05-16 16:10:51 +03:00
Oleksandr Prypkhan
b63b71a3e7 feat: AWS S3 force path style 2024-05-01 00:23:36 +03:00
Cyril Rohr
6de5dcf3c3
Initialize s3client once 2024-02-28 09:29:17 +00:00
Cyril Rohr
c4c60d1f09
Unset existing credentials when running from RunsOn 2024-02-28 08:26:48 +00:00
Cyril Rohr
ede15a2f5d
better defaults 2024-02-15 16:00:07 +00:00
Cyril Rohr
e477012777
RunsOn implem 2024-02-15 12:38:10 +00:00