Skip to content

[WIP][SYSTEMDS-3468] Adding the outline for the survey of builtin functions #1735

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
BACtaki wants to merge 2 commits into
base: main
Choose a base branch
from
Open

[WIP][SYSTEMDS-3468] Adding the outline for the survey of builtin functions #1735

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
7257dc4
Adding the outline for the survey of builtin functions
BACtaki Nov 23, 2022
42955f1
Adding readme for build and deploy phases
BACtaki Nov 23, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/survey/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
This is a survey of the capabilities of SystemDS compared to other popular languages and libraries. The survey has been
broken down into 3 components based on the different phases of the ML lifecycle: source, build, and deploy. A further
grouping is based on the DSLs supported by SystemDS: DML and Python.

# References
1. Boehm, Matthias, Arun Kumar, and Jun Yang. "Data management in machine learning systems." Synthesis Lectures on Data
Management 11.1 (2019): 1-173.
9 changes: 9 additions & 0 deletions docs/survey/build/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Overview

The build phase of the ML lifecycle includes the following tasks [1]:
1. Model training
2. Model tuning and analysis
3. Model validation

# References
1. Hapke, Hannes, and Catherine Nelson. Building machine learning pipelines. O'Reilly Media, 2020.
9 changes: 9 additions & 0 deletions docs/survey/deploy/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Overview

The deploy phase of the ML lifecycle includes the following tasks [1, 2]:
1. Model deployment
2. Monitoring

# References
1. Hapke, Hannes, and Catherine Nelson. Building machine learning pipelines. O'Reilly Media, 2020.
2. https://www.tensorflow.org/tfx
9 changes: 9 additions & 0 deletions docs/survey/source/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Overview

The source phase of the ML lifecycle includes the following tasks [1]:
1. Data ingestion
2. Data validation
3. Data preprocessing

# References
1. Hapke, Hannes, and Catherine Nelson. Building machine learning pipelines. O'Reilly Media, 2020.
6 changes: 6 additions & 0 deletions docs/survey/source/dml/R.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
# Data ingestion
# Data validation
# Data preprocessing

# References
1. https://rpubs.com/prtk/900512
6 changes: 6 additions & 0 deletions docs/survey/source/dml/pandas.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
# Data ingestion
# Data validation
# Data preprocessing

# References
1. https://pandas.pydata.org/pandas-docs/stable/user_guide/index.html
6 changes: 6 additions & 0 deletions docs/survey/source/dml/sklearn.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
# Data ingestion
# Data validation
# Data preprocessing

# References
1. https://scikit-learn.org/stable/modules/classes.html