index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
|
|
|
*
add convert parquet to df function
Ellie
2024-08-22
1
-2
/
+48
|
|
_
|
_
|
/
|
/
|
|
|
*
|
|
|
Merge pull request #90 from ajschofield/alex/fix-extract-lambda-test
Alex
2024-08-22
4
-34
/
+90
|
\
\
\
\
|
*
|
|
|
fix: improve error handling for list_existing_s3_files and tests
Alex Schofield
2024-08-22
2
-8
/
+18
|
*
|
|
|
fix: handle no buckets properly
Alex Schofield
2024-08-22
2
-5
/
+8
|
*
|
|
|
chore: skip transform_lambda tests are they are broken
Alex Schofield
2024-08-22
1
-0
/
+2
|
*
|
|
|
chore: skip secrets_manager tests are they are broken
Alex Schofield
2024-08-22
1
-0
/
+4
|
*
|
|
|
fix: resolve import error
Alex Schofield
2024-08-22
1
-1
/
+1
|
*
|
|
|
fix: mock aws services before importing src functions
Alex Schofield
2024-08-22
1
-9
/
+11
|
*
|
|
|
fix: change default parameters for bucket_name and client
Alex Schofield
2024-08-22
1
-2
/
+9
|
*
|
|
|
fix: inject mock_config into interface error test
Alex Schofield
2024-08-22
1
-2
/
+15
|
*
|
|
|
fix: convert credentials to json dict
Alex Schofield
2024-08-22
1
-7
/
+9
|
*
|
|
|
fix: add missing mock_conn fixture
Alex Schofield
2024-08-22
1
-0
/
+7
|
*
|
|
|
fix: remove bucket deletion for index error test
Alex Schofield
2024-08-22
1
-3
/
+2
|
*
|
|
|
fix: create two mocked buckets and check if extract_bucket is returned
Alex Schofield
2024-08-22
1
-1
/
+8
|
*
|
|
|
feat: autouse credentials fixture
Alex Schofield
2024-08-22
1
-1
/
+1
|
*
|
|
|
fix: update additional fixtures to use scope function
Alex Schofield
2024-08-22
1
-2
/
+2
|
*
|
|
|
fix: change fixture scope to function instead of class
Alex Schofield
2024-08-22
1
-2
/
+2
*
|
|
|
|
Merge pull request #92 from ajschofield/alex/ci-artifact-upload
Alex
2024-08-22
1
-0
/
+7
|
\
\
\
\
\
|
*
|
|
|
|
ci: upload coverage report as artifact
Alex
2024-08-22
1
-0
/
+7
|
/
/
/
/
/
*
|
|
|
|
Merge pull request #91 from ajschofield/alex/ci-pytest-cov-report
Alex
2024-08-22
1
-2
/
+2
|
\
\
\
\
\
|
|
/
/
/
/
|
/
|
|
|
|
|
*
|
|
|
ci: simplify pytest output & add coverage report
Alex
2024-08-22
1
-2
/
+2
|
/
/
/
/
*
|
|
|
Merge pull request #89 from ajschofield/alex/re-add-sm-test
Alex
2024-08-22
1
-0
/
+84
|
\
\
\
\
|
*
|
|
|
test: re-add test_secrets_manager
Alex
2024-08-22
1
-0
/
+84
|
/
/
/
/
*
|
|
|
Merge pull request #88 from ajschofield/alex/rm-sm-test
Alex
2024-08-21
1
-84
/
+0
|
\
\
\
\
|
*
|
|
|
chore: delete test for secrets_manager.py
Alex
2024-08-21
1
-84
/
+0
|
/
/
/
/
*
|
|
|
Merge pull request #87 from ajschofield/ci/add-pythonpath
Alex
2024-08-21
1
-0
/
+3
|
\
\
\
\
|
*
|
|
|
ci: update dev-tests.yml
Alex
2024-08-21
1
-0
/
+3
|
/
/
/
/
*
|
|
|
Merge pull request #86 from ajschofield/alex/fix-ci
Alex
2024-08-21
1
-0
/
+1
|
\
\
\
\
|
|
/
/
/
|
/
|
|
|
|
*
|
|
Update dev-tests.yml
Alex
2024-08-21
1
-0
/
+1
|
/
/
/
*
|
|
Merge pull request #84 from ajschofield/feature/transform_lambda
bulve-ad
2024-08-21
4
-4
/
+120
|
\
\
\
|
*
\
\
Merge branch 'development' into feature/transform_lambda
bulve-ad
2024-08-21
24
-487
/
+676
|
|
\
\
\
|
|
/
/
/
|
/
|
|
|
*
|
|
|
Merge pull request #83 from ajschofield/ci/add-dev-tests-yml
Alex
2024-08-20
1
-0
/
+48
|
\
\
\
\
|
*
|
|
|
ci: remove environment for dev-tests.yml
Alex
2024-08-20
1
-1
/
+0
|
*
|
|
|
ci: create dev-tests.yml
Alex
2024-08-20
1
-0
/
+49
|
/
/
/
/
*
|
|
|
Merge pull request #82 from ajschofield/test/test-branch
Alex
2024-08-20
1
-2
/
+2
|
\
\
\
\
|
*
|
|
|
test: test trigger for ci/cd
Alex Schofield
2024-08-20
1
-2
/
+2
|
/
/
/
/
*
|
|
|
Merge pull request #81 from ajschofield/alex/remove-dev-ga-workflow
Alex
2024-08-20
1
-43
/
+0
|
\
\
\
\
|
|
_
|
_
|
/
|
/
|
|
|
|
*
|
|
chore: rm workflow file from development
Alex
2024-08-20
1
-43
/
+0
|
/
/
/
*
|
|
Merge pull request #79 from ajschofield/ci/actions-trigger
Alex
2024-08-20
1
-0
/
+1
|
\
\
\
|
*
|
|
ci: update deploy.yml
Alex
2024-08-20
1
-0
/
+1
|
/
/
/
*
|
|
Merge pull request #78 from ajschofield/main
Alex
2024-08-20
1
-0
/
+3
|
\
\
\
|
|
|
/
|
|
/
|
|
*
|
Merge pull request #77 from ajschofield/alex/lambda-timeout
Alex
2024-08-20
1
-0
/
+3
|
|
\
\
|
|
*
\
Merge branch 'main' into alex/lambda-timeout
Alex
2024-08-20
0
-0
/
+0
|
|
|
\
\
|
|
|
/
/
|
|
/
|
|
|
*
|
|
Merge pull request #76 from ajschofield/development
Alex
2024-08-20
21
-101
/
+1363
|
|
\
\
\
|
|
/
/
/
|
/
|
|
|
|
|
*
|
hotfix: increase lambda timeout
Alex Schofield
2024-08-20
1
-0
/
+3
|
|
/
/
|
/
|
|
*
|
|
Merge pull request #75 from ajschofield/alex/repo-tidy-up
Alex
2024-08-20
3
-129
/
+0
|
\
\
\
|
*
|
|
chore: tidy-up repository & remove unused files
Alex Schofield
2024-08-20
3
-129
/
+0
|
/
/
/
*
|
|
Merge pull request #74 from ajschofield/alex/tf-lambda-changes
Alex
2024-08-20
2
-5
/
+11
|
\
\
\
|
*
|
|
infra(tf): add ListBucket and GetObject permissions
Alex Schofield
2024-08-20
1
-3
/
+6
|
*
|
|
feat: add more logging for debugging
Alex Schofield
2024-08-20
1
-2
/
+5
|
/
/
/
[prev]
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit