index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
*
|
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-28
3
-148
/
+375
|
*
|
|
|
test: transform refactoring - it now loads parquet files into s3 bucket
Ang Bel
2024-08-28
3
-26
/
+22
|
*
|
|
|
test: refactored fact functions with test passing
Ang Bel
2024-08-28
2
-14
/
+19
|
*
|
|
|
test: fact transformation function for payment test passes, other fact functi...
Ang Bel
2024-08-28
3
-412
/
+229
|
*
|
|
|
add lambda handler updated tests
Ellie
2024-08-27
1
-0
/
+1
|
*
|
|
|
add passing tests for lambda handler
Ellie
2024-08-27
1
-7
/
+9
|
*
|
|
|
add logger error to lambda handler
Ellie
2024-08-27
1
-5
/
+7
|
*
|
|
|
wip: update TestLambdaHandler & lambda_handler function
Alex Schofield
2024-08-27
2
-11
/
+20
|
*
|
|
|
docs: add comments for upload tests
Alex Schofield
2024-08-27
1
-0
/
+3
|
*
|
|
|
test: add lambda_handler tests
Alex Schofield
2024-08-27
1
-6
/
+21
|
*
|
|
|
wip: add test for parquet file conversion
Alex Schofield
2024-08-27
1
-8
/
+51
|
*
|
|
|
refactor: add parameter for sm_secret
Alex Schofield
2024-08-27
1
-3
/
+6
|
*
|
|
|
add passing retrieve secrets tests
Ellie
2024-08-27
1
-5
/
+18
|
*
|
|
|
add json.loads to retrieve secrests function
Ellie
2024-08-27
1
-6
/
+9
|
*
|
|
|
add first retrieve secrets test
Ellie
2024-08-27
1
-11
/
+33
|
*
|
|
|
add test progress
Ellie
2024-08-27
1
-3
/
+4
|
*
|
|
|
remove import as not required
Ellie
2024-08-27
1
-3
/
+5
|
|
*
|
|
moved extract_l & dataframes into own directory in src
HastarTara
2024-08-28
2
-0
/
+0
|
|
/
/
/
|
/
|
|
|
*
|
|
|
Merge pull request #101 from ajschofield/test/transform-helper-functions
bulve-ad
2024-08-27
3
-32
/
+34
|
\
\
\
\
|
*
\
\
\
Merge branch 'development' into test/transform-helper-functions
bulve-ad
2024-08-27
3
-3
/
+291
|
|
\
\
\
\
|
|
/
/
/
/
|
/
|
|
|
|
*
|
|
|
|
Merge pull request #100 from ajschofield/test/transform-helper-functions
bulve-ad
2024-08-27
2
-24
/
+29
|
\
\
\
\
\
|
*
\
\
\
\
Merge branch 'development' into test/transform-helper-functions
bulve-ad
2024-08-27
4
-3
/
+292
|
|
\
\
\
\
\
|
|
/
/
/
/
/
|
/
|
|
|
|
|
*
|
|
|
|
|
Merge pull request #98 from ajschofield/test/transform-helper-functions
bulve-ad
2024-08-27
2
-57
/
+95
|
\
\
\
\
\
\
|
|
_
|
_
|
/
/
/
|
/
|
|
|
|
|
|
*
|
|
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
2
-145
/
+366
*
|
|
|
|
|
Merge pull request #95 from ajschofield/feature/load-lambda
Alex
2024-08-27
3
-3
/
+291
|
\
\
\
\
\
\
|
*
\
\
\
\
\
Merge branch 'development' into feature/load-lambda
Ellie
2024-08-27
5
-13
/
+733
|
|
\
\
\
\
\
\
|
|
/
/
/
/
/
/
|
/
|
|
|
|
|
|
|
*
|
|
|
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-39
/
+80
|
*
|
|
|
|
|
add updated test
Ellie
2024-08-23
1
-4
/
+4
|
*
|
|
|
|
|
add updated tests
Ellie
2024-08-23
1
-1
/
+15
|
*
|
|
|
|
|
add amendendments for upload_dfs_to_db
Ellie
2024-08-23
1
-13
/
+34
|
*
|
|
|
|
|
add retrieve secrets function
Ellie
2024-08-23
1
-1
/
+20
|
*
|
|
|
|
|
add working completed tests for get transform bucket
Ellie
2024-08-23
1
-5
/
+13
|
*
|
|
|
|
|
adds passing transform bucket tests
Ellie
2024-08-23
1
-11
/
+19
|
*
|
|
|
|
|
add get transform bucket test
Ellie
2024-08-23
2
-5
/
+45
|
*
|
|
|
|
|
add amendments to load lambda
Ellie
2024-08-23
1
-29
/
+37
|
*
|
|
|
|
|
add SQLalchemy to requirements
Ellie
2024-08-23
1
-1
/
+2
|
*
|
|
|
|
|
add tests
Ellie
2024-08-23
2
-5
/
+59
|
*
|
|
|
|
|
add get transform bucket function
Ellie
2024-08-23
1
-1
/
+15
|
*
|
|
|
|
|
add improved convert parquet files to df function
Ellie
2024-08-23
1
-14
/
+19
|
*
|
|
|
|
|
add pyarrow to requirements
Ellie
2024-08-23
1
-1
/
+2
|
*
|
|
|
|
|
wip: add test file for load lambda
Ellie
2024-08-22
1
-0
/
+9
|
*
|
|
|
|
|
add convert parquet to df function
Ellie
2024-08-22
1
-2
/
+48
|
|
|
*
|
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
2
-148
/
+368
|
|
|
|
*
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
3
-148
/
+375
|
|
|
|
*
|
|
test: transform refactoring - it now loads parquet files into s3 bucket
Ang Bel
2024-08-27
3
-26
/
+22
|
|
|
|
/
/
/
|
|
|
*
/
/
test: refactored fact functions with test passing
Ang Bel
2024-08-27
2
-14
/
+19
|
|
|
/
/
/
|
|
*
/
/
test: fact transformation function for payment test passes, other fact functi...
Ang Bel
2024-08-27
3
-412
/
+229
|
|
/
/
/
|
/
|
|
|
|
|
*
|
test updates to transform lambda handler
HastarTara
2024-08-27
3
-27
/
+71
|
|
*
|
tests for bucket_name helper
HastarTara
2024-08-27
2
-25
/
+44
|
|
/
/
|
/
|
|
*
|
|
Merge pull request #97 from ajschofield/test/test_transform_lambda
lian-manonog
2024-08-27
4
-150
/
+270
|
\
\
\
[prev]
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit