Release v1.3 - Forum Post Automation & Scraping

🚀 Release v1.3 - Forum Post Automation, Scraping Enhancements, Wikipedia Search

🔥 Key Changes:

✅ Forum Post Automation:

• The bot now automatically creates Discourse forum posts when links are posted or triggered by a keyword.

✅ Scraping Enhancements:

• BeautifulSoup4 is now a required dependency.
• Reddit scraping now extracts:
  • Title
  • Author
  • Statistics (upvotes, comments)
  • Media (text, images, videos, external links)
• Twitter scraping is implemented via snscrape, allowing tweet summaries.

✅ Improved Link Summaries:

• Bot responses are more structured and easier to read.
• Bypass links are displayed cleanly without markdown.
• Debug logging added for tag generation.

✅ Privacy & Blacklist Enhancements:

• New blacklisted storage URLs added for better filtering.
• Blacklist settings for social media, forums, and wiki links can now be configured in .env.

✅ Wikipedia & MediaWiki Search:

• The bot can now fetch summaries from Wikipedia and other MediaWiki-based platforms.

---

📌 Installation Requirements

🔧 BeautifulSoup4 must be installed in the Maubot container.

Option 1: Install via Ansible

If managing Maubot via Ansible, add the following to your configuration:

matrix_bot_maubot_container_image_customizations_enabled: true

matrix_bot_maubot_container_image_customizations_dockerfile_body_custom: |
  RUN pip install --break-system-packages beautifulsoup4

Option 2: Install Manually in Docker

If manually managing Maubot, install inside the container:

docker exec -it <maubot_container_name> pip install --break-system-packages beautifulsoup4

---

✅ Next Steps:

1. Ensure the bot is running properly and verify forum post automation works.
2. Check BeautifulSoup4 installation:

   docker exec -it <maubot_container_name> pip show beautifulsoup4

3. Confirm Wikipedia & MediaWiki search is functional.
4. Test new link summary improvements and blacklist handling.