index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
*
|
|
|
|
Merge pull request #95 from ajschofield/feature/load-lambda
Alex
2024-08-27
3
-3
/
+291
|
\
\
\
\
\
|
*
\
\
\
\
Merge branch 'development' into feature/load-lambda
Ellie
2024-08-27
5
-13
/
+733
|
|
\
\
\
\
\
|
|
/
/
/
/
/
|
/
|
|
|
|
|
|
*
|
|
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-39
/
+80
|
*
|
|
|
|
add updated test
Ellie
2024-08-23
1
-4
/
+4
|
*
|
|
|
|
add updated tests
Ellie
2024-08-23
1
-1
/
+15
|
*
|
|
|
|
add amendendments for upload_dfs_to_db
Ellie
2024-08-23
1
-13
/
+34
|
*
|
|
|
|
add retrieve secrets function
Ellie
2024-08-23
1
-1
/
+20
|
*
|
|
|
|
add working completed tests for get transform bucket
Ellie
2024-08-23
1
-5
/
+13
|
*
|
|
|
|
adds passing transform bucket tests
Ellie
2024-08-23
1
-11
/
+19
|
*
|
|
|
|
add get transform bucket test
Ellie
2024-08-23
2
-5
/
+45
|
*
|
|
|
|
add amendments to load lambda
Ellie
2024-08-23
1
-29
/
+37
|
*
|
|
|
|
add SQLalchemy to requirements
Ellie
2024-08-23
1
-1
/
+2
|
*
|
|
|
|
add tests
Ellie
2024-08-23
2
-5
/
+59
|
*
|
|
|
|
add get transform bucket function
Ellie
2024-08-23
1
-1
/
+15
|
*
|
|
|
|
add improved convert parquet files to df function
Ellie
2024-08-23
1
-14
/
+19
|
*
|
|
|
|
add pyarrow to requirements
Ellie
2024-08-23
1
-1
/
+2
|
*
|
|
|
|
wip: add test file for load lambda
Ellie
2024-08-22
1
-0
/
+9
|
*
|
|
|
|
add convert parquet to df function
Ellie
2024-08-22
1
-2
/
+48
|
|
|
*
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
2
-148
/
+368
|
|
|
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
3
-148
/
+375
|
|
|
|
*
|
test: transform refactoring - it now loads parquet files into s3 bucket
Ang Bel
2024-08-27
3
-26
/
+22
|
|
|
|
/
/
|
|
|
*
/
test: refactored fact functions with test passing
Ang Bel
2024-08-27
2
-14
/
+19
|
|
|
/
/
|
|
*
/
test: fact transformation function for payment test passes, other fact functi...
Ang Bel
2024-08-27
3
-412
/
+229
|
|
/
/
|
/
|
|
|
|
*
test updates to transform lambda handler
HastarTara
2024-08-27
3
-27
/
+71
|
|
*
tests for bucket_name helper
HastarTara
2024-08-27
2
-25
/
+44
|
|
/
|
/
|
*
|
Merge pull request #97 from ajschofield/test/test_transform_lambda
lian-manonog
2024-08-27
4
-150
/
+270
|
\
\
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
3
-59
/
+65
|
*
|
wip: refactored fact payment function
lian-manonog
2024-08-27
2
-8
/
+9
|
*
|
wip: added a bracket in dataframes
lian-manonog
2024-08-27
2
-3
/
+4
|
*
|
Merge pull request #96 from ajschofield/test/dataframes
bulve-ad
2024-08-23
2
-169
/
+233
|
|
\
\
|
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-38
/
+41
|
|
*
|
Merge branch 'test/test_transform_lambda' into test/dataframes
bulve-ad
2024-08-23
11
-283
/
+340
|
|
|
\
\
|
|
|
/
/
|
|
/
|
|
|
*
|
|
wip: writing more tests for the helper functions
lian-manonog
2024-08-23
1
-2
/
+12
|
*
|
|
wip: pushing again
lian-manonog
2024-08-23
3
-9
/
+47
|
/
/
/
*
|
|
Merge pull request #94 from ajschofield/feature/transform-fact-sales-order
lian-manonog
2024-08-23
5
-10
/
+611
|
\
\
\
|
|
_
|
/
|
/
|
|
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
1
-4
/
+3
|
*
|
Removed redundant empty lines of code
lian-manonog
2024-08-23
1
-4
/
+0
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-10
/
+15
|
*
|
trying to resolce git index issue conflicts - commiting was the only solution
lian-manonog
2024-08-23
2
-9
/
+8
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
4
-180
/
+319
|
*
|
Deleted the fact_table schema py files
lian-manonog
2024-08-23
4
-233
/
+157
*
|
|
Merge pull request #90 from ajschofield/alex/fix-extract-lambda-test
Alex
2024-08-22
4
-34
/
+90
|
\
\
\
|
*
|
|
fix: improve error handling for list_existing_s3_files and tests
Alex Schofield
2024-08-22
2
-8
/
+18
|
*
|
|
fix: handle no buckets properly
Alex Schofield
2024-08-22
2
-5
/
+8
|
*
|
|
chore: skip transform_lambda tests are they are broken
Alex Schofield
2024-08-22
1
-0
/
+2
|
*
|
|
chore: skip secrets_manager tests are they are broken
Alex Schofield
2024-08-22
1
-0
/
+4
|
*
|
|
fix: resolve import error
Alex Schofield
2024-08-22
1
-1
/
+1
|
*
|
|
fix: mock aws services before importing src functions
Alex Schofield
2024-08-22
1
-9
/
+11
|
*
|
|
fix: change default parameters for bucket_name and client
Alex Schofield
2024-08-22
1
-2
/
+9
|
*
|
|
fix: inject mock_config into interface error test
Alex Schofield
2024-08-22
1
-2
/
+15
[prev]
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit