Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Release 0.1.0-20240906 #203

Merged
merged 28 commits into from
Sep 6, 2024
Merged

Release 0.1.0-20240906 #203

merged 28 commits into from
Sep 6, 2024

Conversation

moria97
Copy link
Collaborator

@moria97 moria97 commented Sep 6, 2024

No description provided.

wwxxzz and others added 28 commits August 6, 2024 19:35
@wwxxzz
Replace PaiEas LLM with LLI-integration and upgrade python to 3.11 (#148
abcf17b 
)

* Replace PaiEas LLM with LLI-integration and upgrade python version to 3.11

* Replace MyFCDashScope with OpenAILike class

* Fix pyproject dependency
@aero-xi
bug fix (#149)
f15385e
@zt2645802240
Support postgresql load user dict (#150)
fe4d752 
* make format

* Allow not install extension pg_jieba

* table name data_default
@aero-xi @moria97
Convert raptor processor to TransformComponent (#151)
7df7f4b 
* udpate raptor using transform

* modify raptor with transform

* modify raptor and dataloader

---------

Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>
@moria97 @Ceceliachenen
Add clip model (#130)
4f58f66 
* Update

* Add clip model

* Fix oss cache

* Fix cache

* Pdf reader upload image

* Add multimodal

* Update config

* Use two embedding

* Add text_image node

* Add tests

* Fix tests

* fix multi_modal_vector

---------

Co-authored-by: 燃夏 <chenanyu.cay@alibaba-inc.com>
@moria97
Fix docker base image (#152)
6a6a2e7
@aero-xi
change insert to be sync (#153)
b93d7ee
@Ceceliachenen
Personal/ranxia/fix image readme (#155)
684b896 
* fix multi_modal and readme

* fix multi_modal and readme

* fix multi_modal and readme
@Ceceliachenen
fix multi_modal image (#156)
24fff62
@wwxxzz
Support Agentic RAG with intent and functioncalling (#154)
95e4bf3 
* Add intent detection module

* Remove LlmQuery class

* Support API

* Refactor agent module and format toml

* Refactor module tool

* Refactor query api

* Add demo and UI

* remove

* Fix reviews

* Add test for intent and api
@moria97
Add web search (#161)
49961e4 
* Add web search

* Fix lint

* Fix bug

* Update timeout

* Fix bug
@moria97
Fix jieba bug (#163)
312bac4
@moria97
Support PAI-EAS MultiModal LLM (#168)
f79d0c0 
* Support minicpm

* Fix issue
@wwxxzz
Bugfix: PaiEas LLM endpoint & max_tokens (#171)
d1a41d6
@moria97
Fix dashscope interface (#172)
e2e11b2 
* Fix dashscope llm

* Fix bug
@moria97
Fix test bug (#174)
2289b9f
@Ceceliachenen @wwxxzz @moria97
add minerU (#160)
4ef5451 
* add minerU

* add minerU

* add minerU

* Fix nodes id and simi_topK

* remove image url from text

* remove image url from text

* remove image url from text

* Support FAQ query w/o image (#162)

* Support FAQ query w/o image

* Using LLM when query w/o images

* Personal/ranxia/mineru enhancement (#164)

* remove repeat nodes

* show multiple pictures in media

* show multiple pictures in media

* Install miner with poetry (#165)

* fix retriever

* Support OSS Data Loader (#166)

* Support oss data loader

* Skip file which has been uploaded

* Support oss prefix via api

* 1. change image size (#167)

2. limit image number
3. fix retriever answer ui format

* adjust image score (#169)

* merge feature

* merge feature

* merge feature

* merge feature

* Fix bug (#173)

* Support chunk text-overflow display (#170)

* Fix bugs

* Support text-overflow

* Support text-overflow

* Support load MinerU config file automatically (#175)

* Support load MinerU config file automatically

* Modify

* Direct writing the config rather than copying

* Fix multi_modal build docker (#176)

* fix load_config (#177)

* change  multimodal prompt (#178)

* Test Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix test bug (#174) (#179)

Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>

* Fix Dockerfile (#180)

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix docker env (#181)

* Fix Dockerfile

* Fix bugs

* Fix docker env

* Fix docker env

* Fix docker env (#183)

* Fix Dockerfile

* Fix bugs

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Bugfix

* Bugfix for EAS (#184)

* Fix Dockerfile

* Fix bugs

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Bugfix

* Bugfix

* Fix detectron link (#182)

* Update detectron dependency (#185)

* Update dependency

* udpate poetry lock

* fix multimodal_config and prompt (#186)

* fix MinerU readme (#189)

* Add timeout and more logs (#188)

* Personal/ranxia/fix miner u readme (#190)

* fix MinerU readme

* fix MinerU readme

* Personal/ranxia/fix miner u readme (#191)

* fix MinerU readme

* fix MinerU readme

* fix MinerU config

* fix MinerU bug (#192)

* Personal/ranxia/fix test and review bug (#193)

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

---------

Co-authored-by: 筱文 <zxw320697@alibaba-inc.com>
Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>
@Ceceliachenen
fix multimodal readme and config (#195)
08c15e0
@aero-xi @moria97
nl2sql refactoring (#194)
90c4301 
* change insert to be sync

* add nl2sql

* nl2sql setting

* nl2sql setting

* fix test bug

* fix bugs

* data analysis retriever and synthesizer

* fix tests bugs

* add data_analysis ui

* update poetry.lock

* remove unnecessary comment

* add fault tolerance if no file provided

* add minor fault tolerance

* add upload_datasheet

* nl2sql refactor and add db ui

* restore retriever & synthesizer

* update poetry.lock

* Fix list merge

* bug fix

* add default display

---------

Co-authored-by: 陆逊 <luxun.fy@alibaba-inc.com>
@aero-xi @moria97
Personal/xi/nl2sql UI (#196)
6c399b2 
* change insert to be sync

* add nl2sql

* nl2sql setting

* nl2sql setting

* fix test bug

* fix bugs

* data analysis retriever and synthesizer

* fix tests bugs

* add data_analysis ui

* update poetry.lock

* remove unnecessary comment

* add fault tolerance if no file provided

* add minor fault tolerance

* add upload_datasheet

* nl2sql refactor and add db ui

* restore retriever & synthesizer

* update poetry.lock

* Fix list merge

* bug fix

* add default display

* data_analysis ui update

---------

Co-authored-by: 陆逊 <luxun.fy@alibaba-inc.com>
@Ceceliachenen
Personal/ranxia/change max new tokens (#199)
0a90ee6 
* set multimodal llm max_new_tokens

* set multimodal llm max_new_tokens
@moria97
Add trace (#197)
b81cd6c 
* Add trace

* Fix bug

* Push to hangzhou region by default
@aero-xi @moria97
修复tables和descriptions默认配置bug (#198)
5f5453d 
* change insert to be sync

* add nl2sql

* nl2sql setting

* nl2sql setting

* fix test bug

* fix bugs

* data analysis retriever and synthesizer

* fix tests bugs

* add data_analysis ui

* update poetry.lock

* remove unnecessary comment

* add fault tolerance if no file provided

* add minor fault tolerance

* add upload_datasheet

* nl2sql refactor and add db ui

* restore retriever & synthesizer

* update poetry.lock

* Fix list merge

* bug fix

* add default display

* data_analysis ui update

* fix table & description & query_output bugs

* fix inconsistency between frontend and backend data structures

---------

Co-authored-by: 陆逊 <luxun.fy@alibaba-inc.com>
@moria97
Fix nginx routing (#200)
17ab2ea
@moria97
Fix nginx routing (#202)
35d8d06 
* Fix nginx routing

* Fix nginx config
@aero-xi @moria97
add data_analysis doc (#201)
ac45d52 
Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>
@moria97
Merge remote-tracking branch 'origin/main' into feature
d7b22ff
@moria97
Resolve conflict
dda3ed6
@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 6, 2024

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines Covered Coverage Threshold Status
8002 3881 49% 40% 🟢

New Files

File Coverage Status
src/pai_rag/data/rag_oss_dataloader.py 13% 🟢
src/pai_rag/integrations/data_analysis/data_analysis_synthesizer.py 56% 🟢
src/pai_rag/integrations/data_analysis/data_analysis_tool.py 59% 🟢
src/pai_rag/integrations/data_analysis/nl2pandas_retriever.py 67% 🟢
src/pai_rag/integrations/data_analysis/nl2sql_retriever.py 58% 🟢
src/pai_rag/integrations/embeddings/clip/cnclip_embedding.py 43% 🟢
src/pai_rag/integrations/index/multi_modal_index.py 23% 🟢
src/pai_rag/integrations/llms/multimodal/open_ai_alike_multi_modal.py 50% 🟢
src/pai_rag/integrations/query_engine/multi_modal_query_engine.py 20% 🟢
src/pai_rag/integrations/retrievers/multi_modal_retriever.py 26% 🟢
src/pai_rag/integrations/search/bing_search.py 22% 🟢
src/pai_rag/integrations/search/bs4_reader.py 18% 🟢
src/pai_rag/modules/customconfig/custom_config.py 80% 🟢
src/pai_rag/modules/dataanalysis/data_analysis.py 44% 🟢
src/pai_rag/modules/embedding/multi_modal_embedding.py 64% 🟢
src/pai_rag/modules/intentdetection/intent_detection.py 61% 🟢
src/pai_rag/modules/intentdetection/llm_single_detector.py 77% 🟢
src/pai_rag/modules/intentdetection/output_parser.py 67% 🟢
src/pai_rag/modules/search/search.py 81% 🟢
src/pai_rag/utils/embed_utils.py 26% 🟢
src/pai_rag/utils/oss_client.py 31% 🟢
TOTAL 47% 🟢

Modified Files

File Coverage Status
src/pai_rag/app/api/models.py 100% 🟢
src/pai_rag/core/rag_application.py 44% 🟢
src/pai_rag/core/rag_configuration.py 47% 🟢
src/pai_rag/data/rag_dataloader.py 53% 🟢
src/pai_rag/integrations/llms/dashscope/fc_base.py 100% 🟢
src/pai_rag/integrations/nodes/raptor_nodes_enhance.py 100% 🟢
src/pai_rag/integrations/postprocessor/my_simple_weighted_rerank.py 35% 🟢
src/pai_rag/integrations/readers/llama_parse_reader.py 25% 🟢
src/pai_rag/integrations/readers/markdown_reader.py 23% 🟢
src/pai_rag/integrations/readers/pai_image_reader.py 32% 🟢
src/pai_rag/integrations/readers/pai_pdf_reader.py 78% 🟢
src/pai_rag/integrations/retrievers/fusion_retriever.py 41% 🟢
src/pai_rag/integrations/vector_stores/postgresql/postgresql.py 22% 🟢
src/pai_rag/modules/init.py 100% 🟢
src/pai_rag/modules/agent/agent.py 67% 🟢
src/pai_rag/modules/cache/oss_cache.py 91% 🟢
src/pai_rag/modules/datareader/data_loader.py 91% 🟢
src/pai_rag/modules/datareader/datareader_factory.py 69% 🟢
src/pai_rag/modules/embedding/embedding.py 74% 🟢
src/pai_rag/modules/index/index.py 79% 🟢
src/pai_rag/modules/index/index_utils.py 37% 🟢
src/pai_rag/modules/index/my_vector_store_index.py 29% 🟢
src/pai_rag/modules/index/pai_bm25_index.py 77% 🟢
src/pai_rag/modules/index/store.py 54% 🟢
src/pai_rag/modules/llm/function_calling_llm.py 73% 🟢
src/pai_rag/modules/llm/llm_module.py 72% 🟢
src/pai_rag/modules/llm/multi_modal_llm.py 68% 🟢
src/pai_rag/modules/module_registry.py 96% 🟢
src/pai_rag/modules/queryengine/query_engine.py 56% 🟢
src/pai_rag/modules/retriever/my_vector_index_retriever.py 79% 🟢
src/pai_rag/modules/retriever/retriever.py 53% 🟢
src/pai_rag/modules/synthesizer/synthesizer.py 85% 🟢
src/pai_rag/modules/tool/load_and_search_tool_spec.py 34% 🟢
src/pai_rag/modules/tool/tool.py 52% 🟢
src/pai_rag/modules/tool/utils.py 41% 🟢
src/pai_rag/utils/download_models.py 80% 🟢
src/pai_rag/utils/prompt_template.py 100% 🟢
src/pai_rag/utils/tokenizer.py 100% 🟢
TOTAL 65% 🟢

updated for commit: dda3ed6 by action🐍

@moria97 moria97 merged commit dac813e into main Sep 6, 2024
4 checks passed
# for free to join this conversation on GitHub. Already have an account? # to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@moria97 @wwxxzz @aero-xi @zt2645802240 @Ceceliachenen