Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration with other tools/frameworks #115

Open
mglowacki100 opened this issue Jan 8, 2020 · 2 comments
Open

Integration with other tools/frameworks #115

mglowacki100 opened this issue Jan 8, 2020 · 2 comments
Assignees

Comments

@mglowacki100
Copy link

@mglowacki100 mglowacki100 commented Jan 8, 2020

It'd be great to have a list of recommended tools and frameworks that could be easily integrated with fklearn to have production ready and reproducible pipeline.
Even better to have short examples of usage.
For example fklearn could be used with: https://pair-code.github.io/what-if-tool/ and mlflow.
How about kedro (https://github.com/quantumblacklabs/kedro), do you recommend it?

@caique-lima
Copy link
Collaborator

@caique-lima caique-lima commented Jan 9, 2020

@mglowacki100

Sounds as a nice idea. At nubank, our internal framework is similar to Kedro, so I think we can try to write something related to how they can integrate. I'm unsure if we can have an actual list, but maybe describe how to deploy using one frame can give us a nice idea of how to integrate with other ones

@caique-lima caique-lima self-assigned this Jan 9, 2020
@mglowacki100
Copy link
Author

@mglowacki100 mglowacki100 commented Jan 14, 2020

@caique-lima
I think toy-example, how to integrate with kedro would be enough, but if you have better approach it also would be great.
I'm really close to integrate fklearn with mlflow, but I've issue with mlflow itself.
In the meanwhile, here is a sample integration with https://pair-code.github.io/what-if-tool/:

# In[15]:
import dill as pickle
import pandas as pd
from witwidget.notebook.visualization import WitWidget, WitConfigBuilder
# In[16]:
data = pd.read_csv('outime_outspace_hdout.csv')
# In[17]:
data.columns, data.shape
# In[18]:
with open('fkl_model.pkl', 'rb') as pickle_file:
    prediction_function = pickle.load(pickle_file)
# In[19]:
config_builder = (WitConfigBuilder(data.values.tolist(), data.columns.tolist())
  .set_custom_predict_fn(prediction_function)
  .set_target_feature('y')
  .set_model_type('regression'))
# In[20]:
WitWidget(config_builder, height=800)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.