Skip to content

Add support for custom decimal string formatter#125

Merged
jacobrobertbaca merged 8 commits into
masterfrom
feature/decimal-formatted-string-types
Mar 3, 2021
Merged

Add support for custom decimal string formatter#125
jacobrobertbaca merged 8 commits into
masterfrom
feature/decimal-formatted-string-types

Conversation

@dmosorast

Copy link
Copy Markdown
Contributor

Description of change

This PR introduces a new concept: A Singer custom string format type that specifies a decimal value.

The reasoning behind this is to maintain decimal precision throughout ELT pipelines by converting to and from JSON strings and parsing with decimal.Decimal (in Python).

Manual QA steps

  • None, will write automated unittests to exercise this function.

Risks

  • Low, this is an additive feature.

Rollback steps

  • revert this branch

@dmosorast dmosorast left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Turns out I can't request changes since I opened this PR, but these are "Requested Changes" heh

Comment thread singer/transform.py Outdated
Comment thread singer/transform.py Outdated
Comment thread tests/test_transform.py Outdated
Comment thread tests/test_transform.py Outdated
Jacob Baca added 2 commits March 3, 2021 19:30

@dmosorast dmosorast left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One more change.

Comment thread tests/test_transform.py Outdated

@dmosorast dmosorast left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Approved without actually being able to hit the checkbox, but I think this is good to go ✅ :shipit:

@jacobrobertbaca
jacobrobertbaca merged commit 0892140 into master Mar 3, 2021
@jacobrobertbaca
jacobrobertbaca deleted the feature/decimal-formatted-string-types branch March 3, 2021 20:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants