index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
*
|
|
fix(extract_lambda): parse secrets string as json dict to access secret values
Alex Schofield
2024-08-20
1
-1
/
+1
|
/
/
/
*
|
|
Merge pull request #70 from ajschofield/alex/tf-secrets-perms
Alex
2024-08-20
1
-0
/
+27
|
\
\
\
|
*
|
|
infra(tf): add resource access for secrets-manager policy doc
Alex Schofield
2024-08-20
1
-1
/
+1
|
*
|
|
infra(tf): add secrets manager permissions
Alex Schofield
2024-08-20
1
-0
/
+27
|
/
/
/
*
|
|
Merge pull request #69 from ajschofield/alex/py-improvements
Alex
2024-08-20
2
-63
/
+89
|
\
\
\
|
*
|
|
fix(extract_lambda): fix UnboundLocalError when db is called before it is ass...
Alex Schofield
2024-08-20
1
-0
/
+1
|
*
|
|
fix(): update expected response message for second test
Alex Schofield
2024-08-20
1
-1
/
+2
|
*
|
|
chore(tests): rename lambda_handler class test functions
Alex Schofield
2024-08-20
1
-3
/
+3
|
*
|
|
fix(): update expected response message
Alex Schofield
2024-08-20
1
-4
/
+8
|
*
|
|
refactor: optimise s3 streaming & file naming
Alex Schofield
2024-08-19
1
-11
/
+6
|
*
|
|
feat: use buffers for s3 upload instead of csv files
Alex Schofield
2024-08-19
1
-17
/
+33
|
*
|
|
refactor: remove print statements in process_and_upload_tables
Alex Schofield
2024-08-19
1
-2
/
+0
|
*
|
|
refactor: add timestamp function in extract_lambda.py
Alex Schofield
2024-08-19
1
-12
/
+17
|
*
|
|
Merge branch 'development' into alex/py-improvements
Alex Schofield
2024-08-19
1
-7
/
+22
|
|
\
\
\
|
*
|
|
|
chore: reorganise imports in extract_lambda
Alex Schofield
2024-08-19
1
-5
/
+5
|
*
|
|
|
refactor(retrieve_secrets): add logging for ClientError
Alex Schofield
2024-08-19
1
-0
/
+1
|
*
|
|
|
refactor(retrieve_secrets): improve error handling when retrieving secrets
Alex Schofield
2024-08-19
1
-0
/
+3
|
*
|
|
|
refactor(lambda_handler): remove unnecessary else statement
Alex Schofield
2024-08-19
1
-8
/
+7
|
*
|
|
|
refactor(retrieve_secrets): use aws recommended method for retrieving secrets
Alex Schofield
2024-08-19
1
-8
/
+11
|
*
|
|
|
refactor(log): implement logging ancestry - avoid using root logger
Alex Schofield
2024-08-19
1
-1
/
+1
*
|
|
|
|
Merge pull request #68 from ajschofield/main
Alex
2024-08-20
1
-3
/
+3
|
\
\
\
\
\
|
|
_
|
/
/
/
|
/
|
|
/
/
|
|
|
/
/
|
|
/
|
|
|
*
|
|
ci: update .deepsource.toml
deepsource-io[bot]
2024-08-19
1
-3
/
+3
*
|
|
|
Merge pull request #67 from ajschofield/alex/tf-perms-fix
Alex
2024-08-19
1
-7
/
+22
|
\
\
\
\
|
|
_
|
/
/
|
/
|
|
|
|
*
|
|
fix(tf): re-add separate random_string suffixes in events.tf
Alex Schofield
2024-08-19
1
-7
/
+19
|
*
|
|
fix(tf): lambda permissions should be created before destroyed
Alex Schofield
2024-08-19
1
-3
/
+6
|
/
/
/
*
|
|
Merge pull request #66 from ajschofield/alex/tf-improvements
Alex
2024-08-19
7
-139
/
+217
|
\
\
\
|
*
|
|
fix(tf): correct random_string to random in main.tf
Alex Schofield
2024-08-19
1
-1
/
+1
|
*
|
|
infra(tf): add version constraint for random in main.tf
Alex Schofield
2024-08-19
1
-0
/
+4
|
*
|
|
infra(tf): remove unused declaration in vars.tf
Alex Schofield
2024-08-19
1
-5
/
+0
|
*
|
|
docs(tf): remove redundant comments
Alex Schofield
2024-08-19
1
-9
/
+9
|
*
|
|
infra(tf): remove repetitive suffix resources in events.tf
Alex Schofield
2024-08-19
1
-19
/
+7
|
*
|
|
docs(tf): improve legibility of events.tf sections
Alex Schofield
2024-08-19
1
-1
/
+16
|
*
|
|
infra(tf): add versioning to lambda_code_bucket
Alex Schofield
2024-08-19
1
-0
/
+7
|
*
|
|
infra(tf): experimental - add versioning to protect against accidental delete...
Alex Schofield
2024-08-19
1
-0
/
+15
|
*
|
|
docs(tf): correct lambda bucket name tag
Alex Schofield
2024-08-19
1
-1
/
+1
|
*
|
|
docs(tf): improve legibility of s3.tf sections
Alex Schofield
2024-08-19
1
-3
/
+12
|
*
|
|
chore(tf): add tags to s3 buckets
Alex Schofield
2024-08-19
1
-0
/
+10
|
*
|
|
infra(tf): add md5/source_code_hash checks for lambda layer
Alex Schofield
2024-08-19
1
-0
/
+2
|
*
|
|
docs(tf): add information about layer zip creation
Alex Schofield
2024-08-19
1
-0
/
+2
|
*
|
|
infra(tf): only create layer zip if doesn't exist
Alex Schofield
2024-08-19
1
-5
/
+11
|
*
|
|
refactor: change directory at start of the script to terraform folder
Alex Schofield
2024-08-19
1
-1
/
+3
|
*
|
|
refactor(tf): move sections in lambda.tf for better readability
Alex Schofield
2024-08-19
1
-32
/
+37
|
*
|
|
style(tf): improve legibility of lambda.tf sections
Alex Schofield
2024-08-19
1
-4
/
+16
|
*
|
|
feat: ask user if they want to destroy new infrastructure
Alex Schofield
2024-08-19
1
-1
/
+15
|
*
|
|
refactor: Improve deploy script user interaction
Alex Schofield
2024-08-19
1
-4
/
+26
|
*
|
|
feat(deploy.sh): exit if any command returns non-zero status
Alex Schofield
2024-08-19
1
-0
/
+3
|
*
|
|
feat: create shell script for terraform destroy/apply
Alex Schofield
2024-08-19
1
-0
/
+15
|
*
|
|
infra(tf): add state file encryption
Alex Schofield
2024-08-19
1
-3
/
+4
|
*
|
|
chore(tf): replace static tag values in main.tf with variables
Alex Schofield
2024-08-19
2
-4
/
+24
|
*
|
|
infra(tf): enforce version constraint on terraform
Alex Schofield
2024-08-19
1
-0
/
+1
[prev]
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit