index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
*
add lambda handler updated tests
Ellie
2024-08-27
1
-0
/
+1
*
add passing tests for lambda handler
Ellie
2024-08-27
1
-7
/
+9
*
add logger error to lambda handler
Ellie
2024-08-27
1
-5
/
+7
*
wip: update TestLambdaHandler & lambda_handler function
Alex Schofield
2024-08-27
2
-11
/
+20
*
docs: add comments for upload tests
Alex Schofield
2024-08-27
1
-0
/
+3
*
test: add lambda_handler tests
Alex Schofield
2024-08-27
1
-6
/
+21
*
wip: add test for parquet file conversion
Alex Schofield
2024-08-27
1
-8
/
+51
*
refactor: add parameter for sm_secret
Alex Schofield
2024-08-27
1
-3
/
+6
*
add passing retrieve secrets tests
Ellie
2024-08-27
1
-5
/
+18
*
add json.loads to retrieve secrests function
Ellie
2024-08-27
1
-6
/
+9
*
add first retrieve secrets test
Ellie
2024-08-27
1
-11
/
+33
*
add test progress
Ellie
2024-08-27
1
-3
/
+4
*
remove import as not required
Ellie
2024-08-27
1
-3
/
+5
*
Merge pull request #95 from ajschofield/feature/load-lambda
Alex
2024-08-27
3
-3
/
+291
|
\
|
*
Merge branch 'development' into feature/load-lambda
Ellie
2024-08-27
5
-13
/
+733
|
|
\
|
|
/
|
/
|
*
|
Merge pull request #97 from ajschofield/test/test_transform_lambda
lian-manonog
2024-08-27
4
-150
/
+270
|
\
\
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-27
3
-59
/
+65
|
*
|
wip: refactored fact payment function
lian-manonog
2024-08-27
2
-8
/
+9
|
*
|
wip: added a bracket in dataframes
lian-manonog
2024-08-27
2
-3
/
+4
|
*
|
Merge pull request #96 from ajschofield/test/dataframes
bulve-ad
2024-08-23
2
-169
/
+233
|
|
\
\
|
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-38
/
+41
|
|
*
|
Merge branch 'test/test_transform_lambda' into test/dataframes
bulve-ad
2024-08-23
11
-283
/
+340
|
|
|
\
\
|
|
|
/
/
|
|
/
|
|
|
*
|
|
wip: writing more tests for the helper functions
lian-manonog
2024-08-23
1
-2
/
+12
|
*
|
|
wip: pushing again
lian-manonog
2024-08-23
3
-9
/
+47
|
/
/
/
*
|
|
Merge pull request #94 from ajschofield/feature/transform-fact-sales-order
lian-manonog
2024-08-23
5
-10
/
+611
|
\
\
\
|
*
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
1
-4
/
+3
|
*
|
|
Removed redundant empty lines of code
lian-manonog
2024-08-23
1
-4
/
+0
|
*
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-10
/
+15
|
*
|
|
trying to resolce git index issue conflicts - commiting was the only solution
lian-manonog
2024-08-23
2
-9
/
+8
|
*
|
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
4
-180
/
+319
|
*
|
|
Deleted the fact_table schema py files
lian-manonog
2024-08-23
4
-233
/
+157
|
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-155
/
+330
|
|
*
|
tests: additional tests written (pass) for dim tables transformation. Fact tr...
Ang Bel
2024-08-23
2
-61
/
+82
|
|
*
|
fix: refactoring for create_dim_date to include all date columns from all fac...
Ang Bel
2024-08-23
1
-20
/
+13
|
|
*
|
removed duplicate functions
T-Aji
2024-08-23
1
-16
/
+69
|
|
*
|
removed duplicate functions
T-Aji
2024-08-23
1
-89
/
+28
|
|
/
/
|
*
|
dataframes combined into one file
T-Aji
2024-08-23
1
-0
/
+238
|
*
|
Merge branch 'feature/transform-fact-sales-order' of https://github.com/ajsch...
T-Aji
2024-08-23
4
-10
/
+62
|
|
\
\
|
|
*
|
wip: wrote pseudocode for lambda handler in writing df to parquet file format...
lian-manonog
2024-08-22
3
-6
/
+56
|
|
*
|
Refactored tests for transform lambda - all passing now
lian-manonog
2024-08-22
1
-4
/
+6
|
*
|
|
payment schema added
T-Aji
2024-08-23
2
-2
/
+46
|
|
/
/
|
*
|
complete code for tables for purchase schema including a scrape for currency...
Ang Bel
2024-08-22
1
-18
/
+48
|
*
|
add fact table
T-Aji
2024-08-22
1
-50
/
+0
|
*
|
Merge branch 'feature/transform-fact-sales-order' of https://github.com/ajsch...
T-Aji
2024-08-22
1
-23
/
+30
|
|
\
\
|
|
*
|
refactored approach to writing transformation as functions per df. WIP
Ang Bel
2024-08-22
1
-23
/
+30
|
*
|
|
add fact table
T-Aji
2024-08-22
1
-4
/
+31
|
|
/
/
|
*
|
passing TestCreateDimCurrency
T-Aji
2024-08-22
1
-1
/
+18
|
*
|
passing tests create_dim_design and create_dim_staff
T-Aji
2024-08-22
2
-0
/
+90
|
*
|
refactor df creation into func
T-Aji
2024-08-22
1
-70
/
+34
|
*
|
wip: creating dim dataframes
T-Aji
2024-08-22
3
-9
/
+58
|
|
\
\
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit