Feature: Notion Data Source

[anaselmhamdi]

Notion data source

• The Data Source syncs all pages and children blocks that the integration has been allowed access to
• I do a very simple parsing where I parse all the rich_text blocks' plain_text to create paragraph to index
• I had to remove the line from parsers.pdf import split_PDF_into_paragraphs as it wouldn't let me run the app otherwise. It looked like the line wasn't used anywhere though
• I have no issues running the app and indexing documents

Let me know if you want me to add more details for the Notion integration setup, I can also embed a Loom video if you guys wish.

Changes

• Added notion.py data source
• Added Notion config in UI
• Added Notion logo
• Removed (orphan ?) from parsers.pdf import split_PDF_into_paragraphs in app/indexing/index_documents.py

UI Screenshots

Data panel:

Data source setup:

Actual search result:

[yuvalsteuer]

Hi this is great! have you thought or adding a notion element for ticket/issues. we have a prebuilt UI element that might go well.

[yuvalsteuer]

can you take pictures of the different UI elements?

• During the setup stage.
• Datasource setup.
• Actual search result.
  etc...

Thanks for taking the time and contributing to this project. you're awesome.

[anaselmhamdi]

Sure, I'll do it this week !

[anaselmhamdi]

@yuvalsteuer I'm back and:

• I added screenshots of the UI with the elements you talked about => I edited the intial PR comment
• I also added logic to index all the database related pages
• I've seen the UI element but i was thinking of maybe doing it in another PR