Skip to content

Commit 15416d4

Browse files
ikxplainlucas-aixplainthiago-aixplainmikelam-us-aixplainThiago Castro Ferreira
authored
Merge to prod (aixplain#311)
* Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Update Finetuner functional tests (#112) * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Add new LLMs finetuner models (mistral and solar) (#128) * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Merge to test (#135) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Merge dev to test (#137) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mik…
1 parent 6bbf8e9 commit 15416d4

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

64 files changed

+2886
-1552
lines changed

.pre-commit-config.yaml

+1-1
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ repos:
33
hooks:
44
- id: pytest-check
55
name: pytest-check
6-
entry: coverage run -m pytest tests/unit
6+
entry: coverage run --source=. -m pytest tests/unit
77
language: python
88
pass_filenames: false
99
types: [python]

aixplain/cli_groups.py

+21-6
Original file line numberDiff line numberDiff line change
@@ -21,28 +21,43 @@
2121
CLI Runner
2222
"""
2323
import click
24-
from aixplain.factories.cli.model_factory_cli import list_host_machines, list_functions, create_asset_repo, asset_repo_login, onboard_model, deploy_huggingface_model, get_huggingface_model_status, list_gpus
24+
from aixplain.factories.cli.model_factory_cli import (
25+
list_host_machines,
26+
list_functions,
27+
create_asset_repo,
28+
asset_repo_login,
29+
onboard_model,
30+
deploy_huggingface_model,
31+
get_huggingface_model_status,
32+
list_gpus,
33+
)
2534

26-
@click.group('cli')
35+
36+
@click.group("cli")
2737
def cli():
2838
pass
2939

30-
@click.group('list')
40+
41+
@click.group("list")
3142
def list():
3243
pass
3344

34-
@click.group('get')
45+
46+
@click.group("get")
3547
def get():
3648
pass
3749

38-
@click.group('create')
50+
51+
@click.group("create")
3952
def create():
4053
pass
4154

42-
@click.group('onboard')
55+
56+
@click.group("onboard")
4357
def onboard():
4458
pass
4559

60+
4661
cli.add_command(list)
4762
cli.add_command(get)
4863
cli.add_command(create)

aixplain/enums/__init__.py

+1
Original file line numberDiff line numberDiff line change
@@ -13,3 +13,4 @@
1313
from .supplier import Supplier
1414
from .sort_by import SortBy
1515
from .sort_order import SortOrder
16+
from .response_status import ResponseStatus

aixplain/enums/asset_status.py

+18-16
Original file line numberDiff line numberDiff line change
@@ -24,20 +24,22 @@
2424
from enum import Enum
2525
from typing import Text
2626

27+
2728
class AssetStatus(Text, Enum):
28-
HIDDEN = 'hidden'
29-
SCHEDULED = 'scheduled'
30-
ONBOARDING = 'onboarding'
31-
ONBOARDED = 'onboarded'
32-
PENDING = 'pending'
33-
FAILED = 'failed'
34-
TRAINING = 'training'
35-
REJECTED = 'rejected'
36-
ENABLING = 'enabling'
37-
DELETING = 'deleting'
38-
DISABLED = 'disabled'
39-
DELETED = 'deleted'
40-
IN_PROGRESS = 'in_progress'
41-
COMPLETED = 'completed'
42-
CANCELING = 'canceling'
43-
CANCELED = 'canceled'
29+
DRAFT = "draft"
30+
HIDDEN = "hidden"
31+
SCHEDULED = "scheduled"
32+
ONBOARDING = "onboarding"
33+
ONBOARDED = "onboarded"
34+
PENDING = "pending"
35+
FAILED = "failed"
36+
TRAINING = "training"
37+
REJECTED = "rejected"
38+
ENABLING = "enabling"
39+
DELETING = "deleting"
40+
DISABLED = "disabled"
41+
DELETED = "deleted"
42+
IN_PROGRESS = "in_progress"
43+
COMPLETED = "completed"
44+
CANCELING = "canceling"
45+
CANCELED = "canceled"

aixplain/enums/data_subtype.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,6 @@ class DataSubtype(Enum):
3232
RACE = "race"
3333
SPLIT = "split"
3434
TOPIC = "topic"
35-
35+
3636
def __str__(self):
3737
return self._value_

aixplain/enums/function.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@ def load_functions():
5555
if input_data_object["required"] is True
5656
},
5757
"output": {output_data_object["dataType"] for output_data_object in function["output"]},
58-
"spec": function
58+
"spec": function,
5959
}
6060
for function in resp["items"]
6161
}

aixplain/enums/response_status.py

+31
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
__author__ = "thiagocastroferreira"
2+
3+
"""
4+
Copyright 2024 The aiXplain SDK authors
5+
6+
Licensed under the Apache License, Version 2.0 (the "License");
7+
you may not use this file except in compliance with the License.
8+
You may obtain a copy of the License at
9+
10+
http://www.apache.org/licenses/LICENSE-2.0
11+
12+
Unless required by applicable law or agreed to in writing, software
13+
distributed under the License is distributed on an "AS IS" BASIS,
14+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
15+
See the License for the specific language governing permissions and
16+
limitations under the License.
17+
18+
Author: Duraikrishna Selvaraju, Thiago Castro Ferreira, Shreyas Sharma and Lucas Pavanelli
19+
Date: February 21st 2024
20+
Description:
21+
Asset Enum
22+
"""
23+
24+
from enum import Enum
25+
from typing import Text
26+
27+
28+
class ResponseStatus(Text, Enum):
29+
IN_PROGRESS = "IN_PROGRESS"
30+
SUCCESS = "SUCCESS"
31+
FAILED = "FAILED"

aixplain/enums/storage_type.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -30,4 +30,4 @@ class StorageType(Enum):
3030
FILE = "file"
3131

3232
def __str__(self):
33-
return self._value_
33+
return self._value_

aixplain/enums/supplier.py

+1
Original file line numberDiff line numberDiff line change
@@ -48,6 +48,7 @@ def load_suppliers():
4848
headers = {"x-aixplain-key": aixplain_key, "Content-Type": "application/json"}
4949
else:
5050
headers = {"x-api-key": api_key, "Content-Type": "application/json"}
51+
logging.debug(f"Start service for GET API Creation - {url} - {headers}")
5152
r = _request_with_retry("get", url, headers=headers)
5253
if not 200 <= r.status_code < 300:
5354
raise Exception(

aixplain/factories/agent_factory/__init__.py

+65-85
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,6 @@
3434
from aixplain.utils import config
3535
from typing import Dict, List, Optional, Text, Union
3636

37-
from aixplain.factories.agent_factory.utils import build_agent, validate_llm, validate_name
3837
from aixplain.utils.file_utils import _request_with_retry
3938
from urllib.parse import urljoin
4039

@@ -65,74 +64,49 @@ def create(
6564
Returns:
6665
Agent: created Agent
6766
"""
68-
validate_name(name)
69-
# validate LLM ID
70-
validate_llm(llm_id)
67+
from aixplain.factories.agent_factory.utils import build_agent
7168

69+
agent = None
70+
url = urljoin(config.BACKEND_URL, "sdk/agents")
71+
headers = {"x-api-key": api_key}
72+
73+
if isinstance(supplier, dict):
74+
supplier = supplier["code"]
75+
elif isinstance(supplier, Supplier):
76+
supplier = supplier.value["code"]
77+
78+
payload = {
79+
"name": name,
80+
"assets": [tool.to_dict() for tool in tools],
81+
"description": description,
82+
"supplier": supplier,
83+
"version": version,
84+
"llmId": llm_id,
85+
"status": "draft",
86+
}
87+
agent = build_agent(payload=payload, api_key=api_key)
88+
agent.validate()
89+
response = "Unspecified error"
7290
try:
73-
agent = None
74-
url = urljoin(config.BACKEND_URL, "sdk/agents")
75-
headers = {"x-api-key": api_key}
76-
77-
if isinstance(supplier, dict):
78-
supplier = supplier["code"]
79-
elif isinstance(supplier, Supplier):
80-
supplier = supplier.value["code"]
81-
82-
tool_payload = []
83-
for tool in tools:
84-
if isinstance(tool, ModelTool):
85-
tool.validate()
86-
tool_payload.append(
87-
{
88-
"function": tool.function.value if tool.function is not None else None,
89-
"type": "model",
90-
"description": tool.description,
91-
"supplier": tool.supplier.value["code"] if tool.supplier else None,
92-
"version": tool.version if tool.version else None,
93-
"assetId": tool.model,
94-
}
95-
)
96-
elif isinstance(tool, PipelineTool):
97-
tool.validate()
98-
tool_payload.append(
99-
{
100-
"assetId": tool.pipeline,
101-
"description": tool.description,
102-
"type": "pipeline",
103-
}
104-
)
105-
else:
106-
raise Exception("Agent Creation Error: Tool type not supported.")
107-
108-
payload = {
109-
"name": name,
110-
"assets": tool_payload,
111-
"description": description,
112-
"supplier": supplier,
113-
"version": version,
114-
"llmId": llm_id,
115-
}
116-
117-
logging.info(f"Start service for POST Create Agent - {url} - {headers} - {json.dumps(payload)}")
91+
logging.debug(f"Start service for POST Create Agent - {url} - {headers} - {json.dumps(payload)}")
11892
r = _request_with_retry("post", url, headers=headers, json=payload)
119-
if 200 <= r.status_code < 300:
120-
response = r.json()
121-
agent = build_agent(payload=response, api_key=api_key)
122-
else:
123-
error = r.json()
124-
error_msg = "Agent Onboarding Error: Please contact the administrators."
125-
if "message" in error:
126-
msg = error["message"]
127-
if error["message"] == "err.name_already_exists":
128-
msg = "Agent name already exists."
129-
elif error["message"] == "err.asset_is_not_available":
130-
msg = "Some tools are not available."
131-
error_msg = f"Agent Onboarding Error (HTTP {r.status_code}): {msg}"
132-
logging.exception(error_msg)
133-
raise Exception(error_msg)
134-
except Exception as e:
135-
raise Exception(e)
93+
response = r.json()
94+
except Exception:
95+
raise Exception("Agent Onboarding Error: Please contact the administrators.")
96+
97+
if 200 <= r.status_code < 300:
98+
agent = build_agent(payload=response, api_key=api_key)
99+
else:
100+
error_msg = f"Agent Onboarding Error: {response}"
101+
if "message" in response:
102+
msg = response["message"]
103+
if response["message"] == "err.name_already_exists":
104+
msg = "Agent name already exists."
105+
elif response["message"] == "err.asset_is_not_available":
106+
msg = "Some tools are not available."
107+
error_msg = f"Agent Onboarding Error (HTTP {r.status_code}): {msg}"
108+
logging.exception(error_msg)
109+
raise Exception(error_msg)
136110
return agent
137111

138112
@classmethod
@@ -141,6 +115,7 @@ def create_model_tool(
141115
model: Optional[Union[Model, Text]] = None,
142116
function: Optional[Union[Function, Text]] = None,
143117
supplier: Optional[Union[Supplier, Text]] = None,
118+
description: Text = "",
144119
) -> ModelTool:
145120
"""Create a new model tool."""
146121
if function is not None and isinstance(function, str):
@@ -154,7 +129,7 @@ def create_model_tool(
154129
break
155130
if isinstance(supplier, str):
156131
supplier = None
157-
return ModelTool(function=function, supplier=supplier, model=model)
132+
return ModelTool(function=function, supplier=supplier, model=model, description=description)
158133

159134
@classmethod
160135
def create_pipeline_tool(cls, description: Text, pipeline: Union[Pipeline, Text]) -> PipelineTool:
@@ -164,37 +139,42 @@ def create_pipeline_tool(cls, description: Text, pipeline: Union[Pipeline, Text]
164139
@classmethod
165140
def list(cls) -> Dict:
166141
"""List all agents available in the platform."""
142+
from aixplain.factories.agent_factory.utils import build_agent
143+
167144
url = urljoin(config.BACKEND_URL, "sdk/agents")
168145
headers = {"x-api-key": config.TEAM_API_KEY, "Content-Type": "application/json"}
169146

147+
resp = {}
170148
payload = {}
171149
logging.info(f"Start service for GET List Agents - {url} - {headers} - {json.dumps(payload)}")
172150
try:
173151
r = _request_with_retry("get", url, headers=headers)
174152
resp = r.json()
153+
except Exception:
154+
raise Exception("Agent Listing Error: Please contact the administrators.")
175155

176-
if 200 <= r.status_code < 300:
177-
agents, page_total, total = [], 0, 0
178-
results = resp
179-
page_total = len(results)
180-
total = len(results)
181-
logging.info(f"Response for GET List Agents - Page Total: {page_total} / Total: {total}")
182-
for agent in results:
183-
agents.append(build_agent(agent))
184-
return {"results": agents, "page_total": page_total, "page_number": 0, "total": total}
185-
else:
186-
error_msg = "Agent Listing Error: Please contact the administrators."
187-
if "message" in resp:
188-
msg = resp["message"]
189-
error_msg = f"Agent Listing Error (HTTP {r.status_code}): {msg}"
190-
logging.exception(error_msg)
191-
raise Exception(error_msg)
192-
except Exception as e:
193-
raise Exception(e)
156+
if 200 <= r.status_code < 300:
157+
agents, page_total, total = [], 0, 0
158+
results = resp
159+
page_total = len(results)
160+
total = len(results)
161+
logging.info(f"Response for GET List Agents - Page Total: {page_total} / Total: {total}")
162+
for agent in results:
163+
agents.append(build_agent(agent))
164+
return {"results": agents, "page_total": page_total, "page_number": 0, "total": total}
165+
else:
166+
error_msg = "Agent Listing Error: Please contact the administrators."
167+
if isinstance(resp, dict) and "message" in resp:
168+
msg = resp["message"]
169+
error_msg = f"Agent Listing Error (HTTP {r.status_code}): {msg}"
170+
logging.exception(error_msg)
171+
raise Exception(error_msg)
194172

195173
@classmethod
196174
def get(cls, agent_id: Text, api_key: Optional[Text] = None) -> Agent:
197175
"""Get agent by id."""
176+
from aixplain.factories.agent_factory.utils import build_agent
177+
198178
url = urljoin(config.BACKEND_URL, f"sdk/agents/{agent_id}")
199179
if config.AIXPLAIN_API_KEY != "":
200180
headers = {"x-aixplain-key": f"{config.AIXPLAIN_API_KEY}", "Content-Type": "application/json"}

0 commit comments

Comments
 (0)