index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
*
extract bucket name retrieval helper function and replace the bucket name pla...
Ang Bel
2024-08-16
1
-4
/
+7
*
Secrets manager integration into the extract lambda reviewed.
Ang Bel
2024-08-16
2
-13
/
+89
*
procefss_and_upload_tables test in progress
Ang Bel
2024-08-15
4
-34
/
+77
*
Merge pull request #34 from ajschofield/feature-extract-lambda-data-extraction
lian-manonog
2024-08-15
6
-21
/
+332
|
\
|
*
Merge pull request #33 from ajschofield/tf-secrets-manager
lian-manonog
2024-08-15
16
-121
/
+600
|
|
\
|
|
*
Merge branch 'feature-extract-lambda-data-extraction' into tf-secrets-manager
lian-manonog
2024-08-15
4
-22
/
+249
|
|
|
\
|
|
|
/
|
|
/
|
|
*
|
test: mid-through test for process_and_upload_tables
T-Aji
2024-08-14
2
-12
/
+39
|
*
|
test: passing test for function connect_to_database
T-Aji
2024-08-14
2
-18
/
+62
|
*
|
feat/passing tests to helper function list_existing_s3_files
T-Aji
2024-08-14
4
-5
/
+60
|
*
|
feat/ add logging & split task into 3 helper functions
T-Aji
2024-08-13
1
-31
/
+109
|
*
|
dumps data to csv
T-Aji
2024-08-13
1
-5
/
+27
|
|
*
wip: secrets manager pushing to merge with extract_lambda
lian-manonog
2024-08-15
4
-0
/
+84
|
|
/
|
/
|
*
|
Merge pull request #28 from ajschofield/feature/iam.tf
Alex
2024-08-15
10
-276
/
+219
|
\
\
|
*
\
Merge branch 'development' into feature/iam.tf
Alex
2024-08-15
2
-0
/
+83
|
|
\
\
|
|
/
/
|
/
|
|
*
|
|
Merge pull request #23 from ajschofield/feature/terraform-additional-function...
lian-manonog
2024-08-15
3
-0
/
+135
|
\
\
\
|
*
\
\
Merge branch 'development' into feature/terraform-additional-functionality
bulve-ad
2024-08-13
5
-20
/
+202
|
|
\
\
\
|
*
|
|
|
restore load_lambda script
Ang Bel
2024-08-13
1
-0
/
+52
|
*
|
|
|
rds.tf file with some placehodlers. Additional set up is required
Ang Bel
2024-08-13
3
-0
/
+162
*
|
|
|
|
Merge pull request #25 from ajschofield/chore/temp-merge-main-to-dev
Alex
2024-08-13
2
-0
/
+87
|
\
\
\
\
\
|
|
_
|
/
/
/
|
/
|
|
|
|
|
*
|
|
|
Merge branch 'main' into chore/temp-merge-main-to-dev
Alex Schofield
2024-08-13
2
-0
/
+87
|
/
|
|
|
|
|
|
|
*
|
Merge branch 'main' into feature/iam.tf
Alex
2024-08-15
2
-0
/
+87
|
|
|
|
\
\
|
|
|
|
*
|
Merge pull request #24 from ajschofield/docs/dev-notes
Alex
2024-08-13
1
-36
/
+81
|
|
|
_
|
/
|
|
|
|
/
|
|
|
|
|
*
|
|
|
|
Merge pull request #21 from ajschofield/feature/ci-tests
Alex
2024-08-13
2
-0
/
+87
|
|
\
\
\
\
\
|
|
*
|
|
|
|
ci: check if python files exist
Alex Schofield
2024-08-13
1
-0
/
+17
|
|
*
|
|
|
|
ci: set cwd to ./terraform.yml
Alex Schofield
2024-08-13
1
-0
/
+3
|
|
*
|
|
|
|
ci: rm unused deploy.yml
Alex Schofield
2024-08-13
1
-33
/
+0
|
|
*
|
|
|
|
ci: add python quality checks (separately)
Alex Schofield
2024-08-13
1
-0
/
+33
|
|
*
|
|
|
|
ci: add terraform quality checks
Alex Schofield
2024-08-13
1
-0
/
+34
|
|
*
|
|
|
|
fix(ci): replace glob pattern for pylint
Alex Schofield
2024-08-13
1
-1
/
+1
|
|
*
|
|
|
|
ci: initialise quality-checks job
Alex Schofield
2024-08-13
1
-0
/
+33
|
|
/
/
/
/
/
|
|
|
*
|
|
fix(tf): create lambda zips before referencing
Alex Schofield
2024-08-15
1
-6
/
+21
|
|
|
*
|
|
Merge branch 'feature/iam/alex-changes' into feature/iam.tf
Alex Schofield
2024-08-15
7
-181
/
+169
|
|
|
|
\
\
\
|
|
|
|
*
|
|
fix(infra/tf): add unique id to permissions
Alex Schofield
2024-08-15
1
-11
/
+34
|
|
|
|
*
|
|
feat(tf): add cloudwatch events iam policies
Alex Schofield
2024-08-14
1
-0
/
+27
|
|
|
|
*
|
|
chore(cleanup): remove unused rds section
Alex Schofield
2024-08-14
1
-3
/
+0
|
|
|
|
*
|
|
chore(cleanup): remove commented out code
Alex Schofield
2024-08-14
1
-11
/
+0
|
|
|
|
*
|
|
infra(tf): temporarily remove events policies
Alex Schofield
2024-08-14
1
-28
/
+0
|
|
|
|
*
|
|
Merge remote-tracking branch 'origin/feature/iam/alex-changes' into feature/i...
Alex Schofield
2024-08-14
6
-143
/
+124
|
|
|
|
|
\
\
\
|
|
|
|
|
*
|
|
test(tf): attempt to solve ResourceConflictException
Alex Schofield
2024-08-14
6
-160
/
+139
|
|
|
|
*
|
|
|
infra(tf): simplify multi_service_role
Alex Schofield
2024-08-14
1
-17
/
+15
|
|
|
|
*
|
|
|
chore(gitignore): ignore .DS_Store
Alex Schofield
2024-08-14
1
-1
/
+2
|
|
|
|
|
/
/
/
|
|
|
*
|
|
|
uncomment s3 objects
Ellie
2024-08-14
1
-17
/
+17
|
|
|
*
|
|
|
amend s3 handler to extract
Ellie
2024-08-14
1
-1
/
+1
|
|
|
*
|
|
|
chage rate 30 seconds
Ellie
2024-08-14
1
-1
/
+1
|
|
|
|
/
/
/
|
|
|
*
|
|
wip: terraform debugging
lian-manonog
2024-08-14
5
-26
/
+35
|
|
|
*
|
|
update gitignore
lian-manonog
2024-08-14
1
-1
/
+2
|
|
|
*
|
|
style change
lian-manonog
2024-08-14
1
-1
/
+1
|
|
|
*
|
|
change the attachment/policies, individual
lian-manonog
2024-08-14
1
-8
/
+23
|
|
|
*
|
|
change the name of bucket in backend bucket
lian-manonog
2024-08-14
1
-1
/
+1
|
|
|
*
|
|
change the s3-key
lian-manonog
2024-08-14
1
-3
/
+3
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit