Skip to content

Commit 84bd827

Browse files
thiago-aixplainlucas-aixplainmikelam-us-aixplainThiago Castro FerreiraThiago Castro Ferreira
authored
Development to Test (#151)
* Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> * Merge to prod. (#130) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Downgraded click Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: ikxplain <88332269+ikxplain@users.noreply.github.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * M 5905660469 enhance benchmark job response (#145) * added fetching score * add simplified benchmark job scores * add getting failuire rates * added explanations to benchmark * temp push 1 * M 5905660469 enhance benchmark job response (#146) * added fetching score * add simplified benchmark job scores * add getting failuire rates * added explanations to benchmark * temp push 1 * undo temp change * New pipeline functional tests (#143) * New pipeline functional tests * Fixe on attribute name * Fixing test cases --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * M 6107719447 check finetuner status (#133) * Finetune status object * New finetune status checker * Covering some None cases * Finetune status checker updates and new unit tests --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * Update metric.py (#147) * Fixing finetune checker test and doc (#150) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: ikxplain <88332269+ikxplain@users.noreply.github.com> Co-authored-by: Shreyas Sharma <85180538+shreyasXplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal>
1 parent 88ab478 commit 84bd827

File tree

2 files changed

+9
-6
lines changed

2 files changed

+9
-6
lines changed

docs/user/user_doc.md

+5-2
Original file line numberDiff line numberDiff line change
@@ -352,9 +352,12 @@ Once a `FineTune` is created (refer to the [section above](#creating-a-finetune)
352352
```python
353353
finetune_model = finetune.start()
354354
```
355-
We receive a model that we can check the fine-tuning status:
355+
We receive a model that we can check the fine-tuning info (status, epoch, training and validation losses):
356356
```python
357-
status = finetune_model.check_finetune_status()
357+
finetune_model_info = finetune_model.check_finetune_status()
358+
epoch = finetune_model_info.epoch
359+
training_loss = finetune_model_info.training_loss
360+
validation_loss = finetune_model_info.validation_loss
358361
```
359362
Status can be one of the following: `onboarding`, `onboarded`, `hidden`, `training`, `deleted`, `enabling`, `disabled`, `failed`, `deleting`.
360363

tests/functional/finetune/finetune_functional_test.py

+4-4
Original file line numberDiff line numberDiff line change
@@ -76,13 +76,13 @@ def test_end2end(run_input_map):
7676
assert "inferenceCost" in cost_map
7777
finetune_model = finetune.start()
7878
start, end = time.time(), time.time()
79-
status = finetune_model.check_finetune_status()
79+
status = finetune_model.check_finetune_status().model_status.value
8080
while status != "onboarded" and (end - start) < TIMEOUT:
81-
status = finetune_model.check_finetune_status()
81+
status = finetune_model.check_finetune_status().model_status.value
8282
assert status != "failed"
8383
time.sleep(5)
8484
end = time.time()
85-
assert finetune_model.check_finetune_status() == "onboarded"
85+
assert finetune_model.check_finetune_status().model_status.value == "onboarded"
8686
result = finetune_model.run(run_input_map["inference_data"])
8787
print(f"Result: {result}")
8888
assert result is not None
@@ -128,4 +128,4 @@ def test_prompt_validator(validate_prompt_input_map):
128128
finetune = FinetuneFactory.create(
129129
str(uuid.uuid4()), dataset_list, model, prompt_template=validate_prompt_input_map["prompt_template"]
130130
)
131-
assert exc_info.type is AssertionError
131+
assert exc_info.type is AssertionError

0 commit comments

Comments
 (0)