03-rag-basics-kg.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Implement RAG with Knowledge Graph and Llama-Index\n",
    "\n",
    "Hallucination is a common problem when working with large language models (LLMs). LLMs generate fluent and coherent <br>\n",
    "text but often generate inaccurate or inconsistent information. One of the ways to prevent hallucination in LLMs is <br> \n",
    "by using external knowledge sources such as databases or knowledge graphs that provide factual information."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import yaml, logging, sys, os\n",
    "from pyvis.network import Network\n",
    "from IPython.display import display\n",
    "from llama_index.llms import AzureOpenAI\n",
    "from llama_index.llm_predictor import LLMPredictor\n",
    "from llama_index import set_global_service_context\n",
    "from llama_index.graph_stores import SimpleGraphStore\n",
    "from llama_index.embeddings import HuggingFaceEmbedding\n",
    "from llama_index.storage.storage_context import StorageContext\n",
    "from llama_index import (\n",
    "                        SimpleDirectoryReader, \n",
    "                        load_graph_from_storage,\n",
    "                        KnowledgeGraphIndex,\n",
    "                        ServiceContext\n",
    "                        )\n",
    "\n",
    "logging.basicConfig(\n",
    "                    stream=sys.stdout, \n",
    "                    level=logging.INFO\n",
    "                    )\n",
    "logging.getLogger().addHandler(logging.StreamHandler(stream=sys.stdout))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "with open('cadentials.yaml') as f:\n",
    "    credentials = yaml.load(f, Loader=yaml.FullLoader)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Configuring LLMs"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/Users/1zuu/miniforge3/envs/llamaindex/lib/python3.9/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html\n",
      "  from .autonotebook import tqdm as notebook_tqdm\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "LLMPredictor is deprecated, please use LLM instead.\n"
     ]
    }
   ],
   "source": [
    "embedding_llm = HuggingFaceEmbedding(model_name=\"BAAI/bge-small-en-v1.5\")\n",
    "llm=AzureOpenAI(\n",
    "                model=credentials['AZURE_ENGINE'],\n",
    "                api_key=credentials['AZURE_OPENAI_API_KEY'],\n",
    "                deployment_name=credentials['AZURE_DEPLOYMENT_ID'],\n",
    "                api_version=credentials['AZURE_OPENAI_API_VERSION'],\n",
    "                azure_endpoint=credentials['AZURE_OPENAI_API_BASE']\n",
    "                )\n",
    "chat_llm = LLMPredictor(llm)\n",
    "\n",
    "graph_store = SimpleGraphStore()\n",
    "\n",
    "service_context = ServiceContext.from_defaults(\n",
    "                                                chunk_size=1000,\n",
    "                                                embed_model=embedding_llm,\n",
    "                                                llm_predictor=chat_llm\n",
    "                                                )\n",
    "storage_context = StorageContext.from_defaults(graph_store=graph_store)\n",
    "\n",
    "set_global_service_context(service_context)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Load Data and Vector Storing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "21\n"
     ]
    }
   ],
   "source": [
    "# Load Data\n",
    "documents = SimpleDirectoryReader(\"./data/new_articles\").load_data()\n",
    "print(len(documents))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- `max_triplets_per_chunk` : it governs the number of relationship triplets processed per data chunk\n",
    "- `include_embeddings` : toggles the inclusion of vector embeddings within the index for advanced analytics."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n"
     ]
    }
   ],
   "source": [
    "if not os.path.exists('./db/03/'):\n",
    "    kg_index = KnowledgeGraphIndex.from_documents( \n",
    "                                            documents=documents,\n",
    "                                            max_triplets_per_chunk=12,\n",
    "                                            service_context=service_context,\n",
    "                                            storage_context=storage_context,\n",
    "                                            include_embeddings=True\n",
    "                                            )\n",
    "    \n",
    "    kg_index.storage_context.persist(persist_dir='./db/03/')\n",
    "\n",
    "else:\n",
    "    kg_index = load_graph_from_storage(storage_context=storage_context.persist(persist_dir='./db/03/'))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Querying"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "query_engine = kg_index.as_query_engine(\n",
    "                                        include_text=True,\n",
    "                                        response_mode =\"tree_summarize\",\n",
    "                                        embedding_mode=\"hybrid\",\n",
    "                                        similarity_top_k=5\n",
    "                                        )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 058565bf-18c7-4ea2-9b39-826837364a15: Microsoft doubles down on AI with new Bing features The company's betting the...\n",
      "> Querying with idx: 058565bf-18c7-4ea2-9b39-826837364a15: Microsoft doubles down on AI with new Bing features The company's betting the...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 7f13f2e3-92e4-4427-9388-984f2b70a1d8: Any image upload tool can be abused, of course, which is why Microsoft is emp...\n",
      "> Querying with idx: 7f13f2e3-92e4-4427-9388-984f2b70a1d8: Any image upload tool can be abused, of course, which is why Microsoft is emp...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: fd853620-602b-4514-811f-591e690c6737: But — as members of the press weren’t given the chance to interact with the l...\n",
      "> Querying with idx: fd853620-602b-4514-811f-591e690c6737: But — as members of the press weren’t given the chance to interact with the l...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 2f8c1725-312f-420e-883c-7333302e9807: WordPress drops Twitter integration, says sharing to Instagram and Mastodon i...\n",
      "> Querying with idx: 2f8c1725-312f-420e-883c-7333302e9807: WordPress drops Twitter integration, says sharing to Instagram and Mastodon i...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 4b8faaab-4d04-4bad-8a2c-490f95c4d863: The best way to avoid a down round is to found an AI startup\n",
      "\n",
      "As we see unico...\n",
      "> Querying with idx: 4b8faaab-4d04-4bad-8a2c-490f95c4d863: The best way to avoid a down round is to found an AI startup\n",
      "\n",
      "As we see unico...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: c6e51e31-ad06-4192-8eda-0adc25a8e731: ChatGPT: Everything you need to know about the AI-powered chatbot\n",
      "\n",
      "ChatGPT, O...\n",
      "> Querying with idx: c6e51e31-ad06-4192-8eda-0adc25a8e731: ChatGPT: Everything you need to know about the AI-powered chatbot\n",
      "\n",
      "ChatGPT, O...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 9a47b2d5-e1a8-42b9-bb09-6e73ec4ae43d: It’s that time of week again, folks — Week in Review (WiR) time. For those ne...\n",
      "> Querying with idx: 9a47b2d5-e1a8-42b9-bb09-6e73ec4ae43d: It’s that time of week again, folks — Week in Review (WiR) time. For those ne...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 486f2622-8502-46ef-a521-4b09ceacdcfa: We shouldn’t be unaware of those risk factors. We can, as we build applicatio...\n",
      "> Querying with idx: 486f2622-8502-46ef-a521-4b09ceacdcfa: We shouldn’t be unaware of those risk factors. We can, as we build applicatio...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 58ffa359-9bd5-44a8-b6b8-66ba9193b871: For a business like OpenAI, its jockey Microsoft, Google or anyone else in th...\n",
      "> Querying with idx: 58ffa359-9bd5-44a8-b6b8-66ba9193b871: For a business like OpenAI, its jockey Microsoft, Google or anyone else in th...\n",
      "INFO:llama_index.indices.knowledge_graph.retrievers:> Querying with idx: 2ca21cfb-d277-41b1-8ec9-8549843e51de: Vint Cerf on the ‘exhilarating mix’ of thrill and hazard at the frontiers of ...\n",
      "> Querying with idx: 2ca21cfb-d277-41b1-8ec9-8549843e51de: Vint Cerf on the ‘exhilarating mix’ of thrill and hazard at the frontiers of ...\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "INFO:httpx:HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n",
      "HTTP Request: POST https://doc-ocr-adl.openai.azure.com//openai/deployments/chat_model/chat/completions?api-version=2023-05-15 \"HTTP/1.1 200 OK\"\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "Response(response=\"The context information mentions that Bing AI is a chatbot launched by Microsoft that is now available to all users globally. It heavily revolves around AI and Microsoft has integrated OpenAI's GPT-4 model into Bing. Bing Chat, which is powered by OpenAI's GPT-4 and DALL-E 2 models, allows for multimodality, meaning it can understand queries with images and text combined, and can create charts and graphs when fed the right prompt and data. Additionally, Bing Chat is getting plugins from partners like OpenTable and Wolfram Alpha, and Actions can translate Bing Chat prompts into automations. Bing AI also allows users to export their Bing Chat histories and can generate images from text prompts.\", source_nodes=[NodeWithScore(node=TextNode(id_='058565bf-18c7-4ea2-9b39-826837364a15', embedding=None, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='7ac4c028-c5b7-4452-b6b0-ad2af27cfdfe', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='7c849b354eea80033da5fb040e00e6b5d0b4dc47f64891218f1c118826904349'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='93f44185-87ec-4bae-bd93-007ffe7d0837', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-04-hugging-face-and-servicenow-release-a-free-code-generating-model.txt', 'file_name': '05-04-hugging-face-and-servicenow-release-a-free-code-generating-model.txt', 'file_type': 'text/plain', 'file_size': 10067, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='b5ef5bb9919cc7774de070529c419f4ef493eb040964429624ab1b973587717a'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='fd853620-602b-4514-811f-591e690c6737', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='b5c2f52d4ea1f7bb52701119bec7158383740db7888640955e3be2a994c991b1')}, hash='17d747ea93f12421bc6e6dd2ab7d885ba61ac71fb7970a51f8ada4c5c82d7bfc', text=\"Microsoft doubles down on AI with new Bing features The company's betting the farm on generative AI\\n\\nMicrosoft is embarking on the next phase of Bing’s expansion. And — no surprise — it heavily revolves around AI.\\n\\nAt a preview event this week in New York City, Microsoft execs including Yusuf Mehdi, the CVP and consumer chief marketing officer, gave members of the press, including this reporter, a look at the range of features heading to Bing over the next few days, weeks and months.\\n\\nThey don’t so much reinvent the wheel as they build on what Microsoft has injected into the Bing experience over the past three months or so. Since launching Bing Chat, its AI-powered chatbot powered by OpenAI’s GPT-4 and DALL-E 2 models, Microsoft says that visitors to Bing — which has grown to exceed 100 million daily active users — have engaged in over half a billion chats and created more than 200 million images.\\n\\nLooking ahead, Bing will become more visual, thanks to more image- and graphic-centric answers in Bing Chat. It’ll also become more personalized, with capabilities that’ll allow users to export their Bing Chat histories and draw in content from third-party plugins (more on those later). And it’ll embrace multimodality, at least in the sense that Bing Chat will be able to answer questions within the context of images.\\n\\n“I think it’s safe to say that we’re underway with the transformation of search,” Mehdi said in prepared remarks. “In our minds, we think that today will be the start of the next generation of this ‘search mission.'”\\n\\nOpen, and visual\\n\\nAs of today, the new Bing — the one with Bing Chat — is now available waitlist-free. Anyone can try it out by signing in with a Microsoft Account.\\n\\nIt’s more or less the experience that launched several months ago. But as alluded to earlier, Bing Chat will soon respond with images — at least where it makes sense. Answers to questions (e.g. “Where is Machu Picchu?”) will be accompanied by relevant images if any exist, much like the standard Bing search flow but condensed into a card-like interface.\\n\\nIn a demo at the event, a spokesperson typed the question “Does the saguaro cactus grow flowers?” and Bing Chat pulled up a paragraph-long response alongside an image of the cactus in question. For me, it evoked the “knowledge panels” in Google Search.\\n\\nMicrosoft isn’t saying which categories of content, exactly, might trigger an image. But it does have filtering in place to prevent explicit images from appearing — or so it claims.\\n\\nSarah Bird, the head of responsible AI at Microsoft, told me that Bing Chat benefits from the filtering and moderation already in place with Bing search. Beyond this, Bing Chat uses a combination of “toxicity classifiers,” or AI models trained to detect potentially harmful prompts, and blacklists to keep the chat relatively clean.\\n\\nThose measures didn’t prevent Bing Chat from going off the rails when it first rolled out in preview in early February, it’s worth noting. Our coverage found the chatbot spouting vaccine misinformation and writing a hateful screed from the perspective of Adolf Hitler. Other reporters got it to make threats, claim multiple identities and even shame them for admonishing it.\\n\\nIn another knock against Microsoft, the company just a few months ago laid off the ethics and society team within its larger AI organization. The move left Microsoft without a dedicated team to ensure its AI principles are closely tied to product design.\\n\\nBird, though, asserts that meaningful progress has been made and that these sorts of AI issues aren’t solved overnight — public though Bing Chat may be. Among other measures, a team of human moderators is in place to watch for abuse, she said, such as users attempting to use Bing Chat to generate phishing emails.\\n\\nBut — as members of the press weren’t given the chance to interact with the latest version of Bing beyond curated demos — I can’t say to what extent all that’s made a difference. It’ll doubtless become clear once more folks get their hands on it.\\n\\nOne aspect of Bing Chat that is improving is the transparency around its responses — specifically responses of a fact-based nature. Soon, when asked to summarize a document or about the contents a document (e.g. “what does this page say about the Brooklyn Bridge?”), whether a 20-page PDF or a Wikipedia article, Bing Chat will include citations indicating from where in the text the information came from. Clicking on them will highlight the corresponding passage.\\n\\nProductivity emergent\\n\\nIn another new feature on the visual front, Bing Chat will be able to create charts and graphs when fed the right prompt and data.\", start_char_idx=0, end_char_idx=4661, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='7f13f2e3-92e4-4427-9388-984f2b70a1d8', embedding=None, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='7ac4c028-c5b7-4452-b6b0-ad2af27cfdfe', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='7c849b354eea80033da5fb040e00e6b5d0b4dc47f64891218f1c118826904349'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='fd853620-602b-4514-811f-591e690c6737', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='b5c2f52d4ea1f7bb52701119bec7158383740db7888640955e3be2a994c991b1'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='cde86e56-b7ee-407f-aa71-04aca8b69bc9', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='31e082f98a92f8e8605c4cf72701515b819360403b7fa5d6041303f76775026f')}, hash='3e2abc14369b19cd684d1da82acf05c7c647f9a1851d2b7a43cbd5f905d01633', text=\"Any image upload tool can be abused, of course, which is why Microsoft is employing automated filtering and hashing to block illicit uploads, according to Bird. The jury’s out on how well these work, though — we weren’t given the chance to test image uploads ourselves.\\n\\nNew chat features\\n\\nMultimodality and new visual features aren’t all that’s coming to Bing Chat.\\n\\nSoon, Bing Chat will store users’ chat histories, letting them pick up where they left off and return to previous chats when they wish. It’s an experience akin to the chat history feature OpenAI recently brought to ChatGPT, showing a list of chats and the bot’s responses to each of those chats.\\n\\nThe specifics of the chat history feature have yet to be ironed out, like how long chats will be stored, exactly. But users will be able to delete their history at any time regardless, Microsoft says — addressing the criticisms several European Union governments had against ChatGPT.\\n\\nBing Chat will also gain export and share functionalities, letting users share conversations on social media or to a Word document. Dena Saunders, a partner GM in Microsoft’s web experiences team, told TechCrunch that a more robust copy-and-paste system is in the works — but not in preview just yet — for graphs and images created through Bing Chat.\\n\\nPerhaps the most transformative addition to Bing Chat, though, is plugins. From partners like OpenTable and Wolfram Alpha, plugins greatly extend what Bing Chat can do, for example helping users book a reservation or create visualizations and get answers to challenging science and math questions.\\n\\nLike chat history, the not-yet-live plugins functionality is in the very preliminary stages. There’s no plugins marketplace to speak of; plugins can be toggled on or off from the Bing Chat web interface.\\n\\nSaunders hinted, but wouldn’t confirm, that the Bing Chat plugins scheme was associated with — or perhaps identical to — OpenAI’s recently introduced plugins for ChatGPT. That’d certainly make sense, given the similarities between the two.\\n\\nEdge, refreshed\\n\\nBing Chat is available through Edge as well as the web, of course. And Edge is getting a fresh coat of paint alongside Bing Chat.\\n\\nFirst previewed in February, the new and improved Edge features rounded corners in line with Microsoft’s Windows 11 design philosophy. Elements in the browser are now more “containerized,” as one Microsoft spokesperson put it, and there’s subtle tweaks throughout, like the Microsoft Account image moving left-of-center.\\n\\nIn Compose, Edge’s Bing Chat-powered tool that can write emails and more given a basic prompt (e.g. “write an invitation to my dog’s birthday party”), a new option lets users adjust the length, phrasing and tone of the generated text to nearly anything they’d like. Type in the desired tone, and Bing Chat will write a message to match — Bird says filters are in place to prevent the use of clearly problematic tones, like “hateful” or “racist.”\\n\\nFar more intriguing than Compose, though — at least to me — are actions in Edge, which translate certain Bing Chat prompts into automations.\\n\\nTyping a command like “bring my passwords from another browser” in Bing Chat in the Edge sidebar opens Edge’s browsing data settings page, while the prompt “play ‘The Devil Wears Prada'” pulls up a list of streaming options including Vudu and (predictably) the Microsoft Store. There’s even an action that automatically organizes — and color-coordinates — browsing tabs.\\n\\nActions are in a primitive stage at present. But it’s clear where Microsoft’s going, here. One imagines actions eventually expanding beyond Edge to reach other Microsoft products, like Office 365, and perhaps one day the whole Windows desktop.\\n\\nSaunders wouldn’t confirm or deny that this is the endgame. “Stay tuned for Microsoft Build,” she told me, referring to Microsoft’s upcoming developer conference. We shall.\", start_char_idx=7502, end_char_idx=11397, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='fd853620-602b-4514-811f-591e690c6737', embedding=None, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='7ac4c028-c5b7-4452-b6b0-ad2af27cfdfe', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='7c849b354eea80033da5fb040e00e6b5d0b4dc47f64891218f1c118826904349'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='058565bf-18c7-4ea2-9b39-826837364a15', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='f42960837e1b8cf05149dbabcbb343f6f52294eda308ff8a1a15cc618a271cd6'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='7f13f2e3-92e4-4427-9388-984f2b70a1d8', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='2e1a7153df703dc50b58f7b8082d0cd38dcbf748645a16ec7a0461e70a309dfc')}, hash='a5fd713730108f984ea0a076aff7c7d8ba8519bbfd14b82e5f1efca3e74281d5', text='But — as members of the press weren’t given the chance to interact with the latest version of Bing beyond curated demos — I can’t say to what extent all that’s made a difference. It’ll doubtless become clear once more folks get their hands on it.\\n\\nOne aspect of Bing Chat that is improving is the transparency around its responses — specifically responses of a fact-based nature. Soon, when asked to summarize a document or about the contents a document (e.g. “what does this page say about the Brooklyn Bridge?”), whether a 20-page PDF or a Wikipedia article, Bing Chat will include citations indicating from where in the text the information came from. Clicking on them will highlight the corresponding passage.\\n\\nProductivity emergent\\n\\nIn another new feature on the visual front, Bing Chat will be able to create charts and graphs when fed the right prompt and data. Previously, asking something like “Which are the most populous cities in Brazil?” would yield a basic list of results. But in a near-future preview, Bing Chat will present those results visually and in the chart type of a user’s choosing.\\n\\nThis seemingly represents a step for Bing toward a full-blown productivity platform, particularly when paired with the enhanced text-to-image generation capabilities coming down the pipeline.\\n\\nIn the coming weeks, Bing Image Creator — Microsoft’s tool that can generate images from text prompts, powered by DALL-E 2 — will understand more languages aside from English (over 100 total). As with English, users will be able to refine the images they generate with follow-up prompts (e.g. “Make an image of a bunny rabbit,” followed by “now make the fur pink”).\\n\\nGenerative art AI has been in the headlines a lot, lately — and not for the most optimistic of reasons necessarily.\\n\\nPlaintiffs have brought several lawsuits against OpenAI and its rival vendors, alleging that copyrighted data — mostly art — was used without their permission to train generative models like DALL-E 2. Generative models “learn” to create art and more by “training” on sample images and text, usually scraped indiscriminately from the public web.\\n\\nI asked Bird about whether Microsoft is exploring ways to compensate creators whose work was swept up in training data, even if the company’s official position is that it’s a matter of fair use. Several platforms launching generative AI tools, including Shutterstock, have kick-started creators funds along these lines. Others, like Spawning, are creating mechanisms to let artists opt out of AI model training altogether.\\n\\nBird implied that these issues will eventually have to be confronted — and that content creators deserve some form of recompense. But she wasn’t willing to commit to anything concrete this week.\\n\\nMultimodal search\\n\\nElsewhere on the image front, Bing Chat is gaining the ability to understand images as well as text. Users will be able to upload images and search the web for related content, for example copying a link to an image of a crocheted octopus and asking Bing Chat the question “how do I make that?” to get step-by-step instructions.\\n\\nMultimodality powers the new page context function in the Edge app for mobile, as well. Users will be able to ask questions in Bing Chat related to the mobile page they’re viewing.\\n\\nMicrosoft wouldn’t say either way, but it seems likely that these new multimodal abilities stem from GPT-4, which can understand images in addition to text. When OpenAI announced GPT-4, it didn’t make the model’s image understanding capabilities available to all customers — and still hasn’t. I’d wager that Microsoft, though, being a major investor in and close collaborator with OpenAI, has some sort of privileged access.\\n\\nAny image upload tool can be abused, of course, which is why Microsoft is employing automated filtering and hashing to block illicit uploads, according to Bird. The jury’s out on how well these work, though — we weren’t given the chance to test image uploads ourselves.\\n\\nNew chat features\\n\\nMultimodality and new visual features aren’t all that’s coming to Bing Chat.\\n\\nSoon, Bing Chat will store users’ chat histories, letting them pick up where they left off and return to previous chats when they wish. It’s an experience akin to the chat history feature OpenAI recently brought to ChatGPT, showing a list of chats and the bot’s responses to each of those chats.\\n\\nThe specifics of the chat history feature have yet to be ironed out, like how long chats will be stored, exactly. But users will be able to delete their history at any time regardless, Microsoft says — addressing the criticisms several European Union governments had against ChatGPT.', start_char_idx=3793, end_char_idx=8450, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='2f8c1725-312f-420e-883c-7333302e9807', embedding=None, metadata={'file_path': 'data/new_articles/05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_name': '05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_type': 'text/plain', 'file_size': 28949, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='fd226f8a-8ad9-4f2e-afbf-aa81b5c1f86f', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_name': '05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_type': 'text/plain', 'file_size': 28949, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='951e81a42942850086b1a06706f99263545713bed7ddefded5420c904dbbae9e'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='81637734-bae6-4e86-a6dd-6d4eec3db704', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_name': '05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_type': 'text/plain', 'file_size': 28949, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='92a267bebf8bd9ee458750ffe0d3eb0ffcb82728136fe7b4ea1edbe5916a16e0'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='d7cca6f5-3e05-43d5-8d88-ad8b78d05b86', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='edfb4256ccb98e888927b5bba996ab58a81831126fc4ac42ce78b6f9dbe73188')}, hash='0630b982f04e8cca642528c62acd73ac5512b154854cf08e15b9dc67beb8049d', text='WordPress drops Twitter integration, says sharing to Instagram and Mastodon is coming instead. The Automattic-owned publishing platform said the Twitter connection on Jetpack and WordPress.com will cease to work, meaning users’ blog posts will no longer be auto-shared to Twitter as before. The company said Elon Musk’s decision to “dramatically change the terms and #” for Twitter’s API was to blame for this decision. The API now starts at $42,000/month for 50 million tweets. The move will likely hurt Twitter more than WordPress, as the latter powers over 40% of the global internet, including WordPress.com blogs.\\n\\nThe Automattic-owned publishing platform said the Twitter connection on Jetpack and WordPress.com will cease to work, meaning users’ blog posts will no longer be auto-shared to Twitter as before. The company said Elon Musk’s decision to “dramatically change the terms and #” for Twitter’s API was to blame for this decision. The API now starts at $42,000/month for 50 million tweets. The move will likely hurt Twitter more than WordPress, as the latter powers over 40% of the global internet, including WordPress.com blogs. Mozilla announced it’s opening up its own Mastodon server — or “instance,” in Mastodon lingo — into private beta testing. The company had said last year it planned to create and begin testing a publicly accessible instance at mozilla.social. It explains its approach to Mastodon will involve high levels of moderation.\\n\\nThe company had said last year it planned to create and begin testing a publicly accessible instance at mozilla.social. It explains its approach to Mastodon will involve high levels of moderation. Twitter announced it would make its API free for public service announcements after New York’s Metro Transit Service (MTS) abandoned the service and the National Weather Services (NWS) said it would no longer auto-post warnings.\\n\\nafter New York’s Metro Transit Service (MTS) abandoned the service and the National Weather Services (NWS) said it would no longer auto-post warnings. TikTok’s U.S. head of trust and safety Eric Han is leaving the company on May 12 as lawmakers weigh a TikTok ban. Han had played a key role in TikTok’s strategy to avoid a U.S. ban.\\n\\nas lawmakers weigh a TikTok ban. Han had played a key role in TikTok’s strategy to avoid a U.S. ban. Discord is making all users change their usernames, the company announced this week. Originally, Discord users had been identified by a name and random number separated by a hash sign, but now it wants to adopt a simpler format so people can more easily share their usernames with others. The new plan will include a unique alphanumeric username with the @ symbol in front of it, plus a freely assignable display name that can be changed at any time.\\n\\nAI\\n\\nSlack introduced SlackGPT, its own generative AI built on Slack’s platform which developers can use to create AI-driven experiences.\\n\\nwhich developers can use to create AI-driven experiences. Microsoft launched its Bing chatbot to all users globally, meaning there’s no more waitlist to get started. It’s also adding more image- and graphic-centric answers in Bing Chat, including by creating graphs and charts and generating images from text prompts. It will also allow users to export their Bing Chat histories. And it will embrace multimodality, meaning it can understand queries with images and text combined. Bing now sees more than 100 million daily active users and says visitors have engaged in over half a billion chats.\\n\\nIt’s also adding more image- and graphic-centric answers in Bing Chat, including by creating graphs and charts and generating images from text prompts. It will also allow users to export their Bing Chat histories. And it will embrace multimodality, meaning it can understand queries with images and text combined. Bing now sees more than 100 million daily active users and says visitors have engaged in over half a billion chats. Plexamp, the music player originally incubated by the Labs division of media company Plex, is tapping into ChatGPT with its latest update. The new feature called “Sonic Sage,” powered by OpenAI’s ChatGPT, will build unique music playlists by scanning users’ libraries and leveraging their TIDAL subscription.\\n\\nMedia & Entertainment\\n\\nFintech\\n\\nYC-backed Kenyan fintech Fingo launched its neobanking app, developed in collaboration with Pan-African financial institution Ecobank Kenya. The company raised $4 million in seed funding after its YC S21 participation.', start_char_idx=14851, end_char_idx=19366, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='4b8faaab-4d04-4bad-8a2c-490f95c4d863', embedding=None, metadata={'file_path': 'data/new_articles/05-06-ai-startups-q1-investments.txt', 'file_name': '05-06-ai-startups-q1-investments.txt', 'file_type': 'text/plain', 'file_size': 1475, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='6eeefba0-4a1c-4147-984b-66d61515dac2', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-06-ai-startups-q1-investments.txt', 'file_name': '05-06-ai-startups-q1-investments.txt', 'file_type': 'text/plain', 'file_size': 1475, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='60452d232361b60100190c612f78a1d8fc6948215ff400a78c33fc24e3e3f43d'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='023b3972-cbf9-44d8-bd6c-a1109c7842b2', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-05-with-deepfloyd-generative-ai-art-gets-a-text-upgrade.txt', 'file_name': '05-05-with-deepfloyd-generative-ai-art-gets-a-text-upgrade.txt', 'file_type': 'text/plain', 'file_size': 5821, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='e43e8609dc619f03b4782c5013fd73717832cf3995271419e7037d6dc79b28d4'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='9a47b2d5-e1a8-42b9-bb09-6e73ec4ae43d', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='908b0329315dba4194e2a11b39336d94c613679f3bcf2f96fde0a0644ef3efaf')}, hash='60452d232361b60100190c612f78a1d8fc6948215ff400a78c33fc24e3e3f43d', text='The best way to avoid a down round is to found an AI startup\\n\\nAs we see unicorns slash staff and the prevalence of down rounds spike, it may seem that the startup ecosystem is chock-full of bad news and little else. That’s not precisely the case.\\n\\nWhile AI, and in particular the generative AI subcategory, are as hot as the sun, not all venture attention is going to the handful of names that you already know. Sure, OpenAI is able to land nine and 10-figure rounds from a murderer’s row of tech investors and mega-cap corporations. And rising companies like Hugging Face and Anthropic cannot stay out of the news, proving that smaller AI-focused startups are doing more than well.\\n\\nIn fact, new data from Carta, which provides cap table management and other services, indicates that AI-focused startups are outperforming their larger peer group at both the seed and Series A stage.\\n\\nThe dataset, which notes that AI-centered startups are raising more and at higher valuations than other startups, indicates that perhaps the best way to avoid a down round today is to build in the artificial intelligence space.\\n\\nWhat the data says\\n\\nPer Carta data relating to the first quarter of the year, seed funding to non-AI startups in the U.S. market that use its services dipped from $1.64 billion to $1.08 billion, or a decline of around 34%. That result is directionally aligned with other data that we’ve seen regarding Q1 2023 venture capital totals; the data points down.', start_char_idx=0, end_char_idx=1469, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='c6e51e31-ad06-4192-8eda-0adc25a8e731', embedding=None, metadata={'file_path': 'data/new_articles/05-03-chatgpt-everything-you-need-to-know-about-the-ai-powered-chatbot.txt', 'file_name': '05-03-chatgpt-everything-you-need-to-know-about-the-ai-powered-chatbot.txt', 'file_type': 'text/plain', 'file_size': 18062, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='aeefdd19-0925-4a3a-89cb-110bf2ecde41', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-03-chatgpt-everything-you-need-to-know-about-the-ai-powered-chatbot.txt', 'file_name': '05-03-chatgpt-everything-you-need-to-know-about-the-ai-powered-chatbot.txt', 'file_type': 'text/plain', 'file_size': 18062, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='e84ed5a0cc2baa6939ee98526261ac30c5c06e08b18b93c8ad4e20f4b7ed6a25'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='934c3800-58ee-402c-b456-d6c12b5f517d', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-03-ai-replace-tv-writers-strike.txt', 'file_name': '05-03-ai-replace-tv-writers-strike.txt', 'file_type': 'text/plain', 'file_size': 4836, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='df06102f84d00a2a175b3d32bc764df6f3b47b3dfb9aaf0d4b8538c5a5cedd8e'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='92cc7c8a-ab74-42d4-889a-8fc920ee2223', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='aff2d3b1a795b061843a0b5c778ffa933707968efa8b0630b94e2e4452f8cd5b')}, hash='949fd95a01d535fd39c109a6a37db0c7643d0125a82fcc5f093ca7811989210d', text='ChatGPT: Everything you need to know about the AI-powered chatbot\\n\\nChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. It’s able to write essays, code and more given short text prompts, hyper-charging productivity. But it also has a more…nefarious side.\\n\\nIn any case, AI tools are not going away — and indeed has expanded dramatically since its launch just a few months ago. Major brands are experimenting with it, using the AI to generate ad and marketing copy, for example.\\n\\nAnd OpenAI is heavily investing in it. ChatGPT was recently super-charged by GPT-4, the latest language-writing model from OpenAI’s labs. Paying ChatGPT users have access to GPT-4, which can write more naturally and fluently than the model that previously powered ChatGPT. In addition to GPT-4, OpenAI recently connected ChatGPT to the internet with plugins available in alpha to users and developers on the waitlist.\\n\\nHere’s a timeline of ChatGPT product updates and releases, starting with the latest, to be updated regularly. We also answer the most common FAQs (see below).\\n\\nTimeline of the most recent ChatGPT updates\\n\\nMay 3, 2023\\n\\nMeta said in a report on May 3 that malware posing as ChatGPT was on the rise across its platforms.The company said that since March 2023, its security teams have uncovered 10 malware families using ChatGPT (and similar themes) to deliver malicious software to users’ devices.\\n\\n“In one case, we’ve seen threat actors create malicious browser extensions available in official web stores that claim to offer ChatGPT-based tools,” said Meta security engineers Duc H. Nguyen and Ryan Victory in a blog post. “They would then promote these malicious extensions on social media and through sponsored search results to trick people into downloading malware.”\\n\\nApril 28, 2023\\n\\nVC firms including Sequoia Capital, Andreessen Horowitz, Thrive and K2 Global are picking up new shares, according to documents seen by TechCrunch. A source tells us Founders Fund is also investing. Altogether the VCs have put in just over $300 million at a valuation of $27 billion to $29 billion. This is separate to a big investment from Microsoft announced earlier this year, a person familiar with the development told TechCrunch, which closed in January. The size of Microsoft’s investment is believed to be around $10 billion, a figure we confirmed with our source.\\n\\nApril 25, 2023\\n\\nCalled ChatGPT Business, OpenAI describes the forthcoming offering as “for professionals who need more control over their data as well as enterprises seeking to manage their end users.”\\n\\n“ChatGPT Business will follow our API’s data usage policies, which means that end users’ data won’t be used to train our models by default,” OpenAI wrote in a blog post. “We plan to make ChatGPT Business available in the coming months.”\\n\\nApril 24, 2023\\n\\nOpenAI applied for a trademark for “GPT,” which stands for “Generative Pre-trained Transformer,” last December. Last month, the company petitioned the USPTO to speed up the process, citing the “myriad infringements and counterfeit apps” beginning to spring into existence.\\n\\nUnfortunately for OpenAI, its petition was dismissed last week. According to the agency, OpenAI’s attorneys neglected to pay an associated fee as well as provide “appropriate documentary evidence supporting the justification of special action.”\\n\\nThat means a decision could take up to five more months.\\n\\nApril 22, 2023\\n\\nAuto-GPT is an open source app created by game developer Toran Bruce Richards that uses OpenAI’s latest text-generating models, GPT-3.5 and GPT-4, to interact with software and services online, allowing it to “autonomously” perform tasks.\\n\\nDepending on what objective the tool’s provided, Auto-GPT can behave in very… unexpected ways. One Reddit user claims that, given a budget of $100 to spend within a server instance, Auto-GPT made a wiki page on cats, exploited a flaw in the instance to gain admin-level access and took over the Python environment in which it was running — and then “killed” itself.\\n\\nApril 18, 2023\\n\\nFTC chair Lina Khan and fellow commissioners warned House representatives of the potential for modern AI technologies, like ChatGPT, to be used to “turbocharge” fraud in a congressional hearing.', start_char_idx=0, end_char_idx=4249, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='9a47b2d5-e1a8-42b9-bb09-6e73ec4ae43d', embedding=None, metadata={'file_path': 'data/new_articles/05-06-amazon-launches-free-channels-check-marks-come-to-gmail-and-openai-raises-more-moolah.txt', 'file_name': '05-06-amazon-launches-free-channels-check-marks-come-to-gmail-and-openai-raises-more-moolah.txt', 'file_type': 'text/plain', 'file_size': 7890, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='c8a47ecd-004e-455d-9dc9-26b00d00d9a0', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-06-amazon-launches-free-channels-check-marks-come-to-gmail-and-openai-raises-more-moolah.txt', 'file_name': '05-06-amazon-launches-free-channels-check-marks-come-to-gmail-and-openai-raises-more-moolah.txt', 'file_type': 'text/plain', 'file_size': 7890, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='03da25fb21fcc275e8264be6027423360db64d033c10f42b62cfe2718cd1a5f5'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='4b8faaab-4d04-4bad-8a2c-490f95c4d863', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-06-ai-startups-q1-investments.txt', 'file_name': '05-06-ai-startups-q1-investments.txt', 'file_type': 'text/plain', 'file_size': 1475, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='11c5b623a8cdc25659505e884f8f619c58126f346e61b5d75cb543b31b2cf98c'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='568b9a55-af0c-4291-9010-ccd702e7e9c2', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='dd93bdfca9ab53bfa8221a3e0d6fdbf04c75543661b629ba61722156a1e01182')}, hash='5d258fa591113ce05e10dfb5a21e548d3a91d5cf7655b73fe72e3b80583ed6d0', text='It’s that time of week again, folks — Week in Review (WiR) time. For those new to the scene, WiR is TechCrunch’s regular newsletter that recaps the biggest tech stories over the past few days. There’s no better digest for the person on the go, we’d argue — but of course, we’re a little biased.\\n\\nBefore we get into the meat of the thing, a quick reminder that TC City Spotlight: Atlanta is fast approaching. On June 7, TechCrunch is headed to Atlanta, where we’ll host a pitch competition, a talk on the economics of equality, a panel discussion on investing in the Atlanta ecosystem and more.\\n\\nElsewhere, there’s a TechCrunch Live event with Persona and Index Ventures on May 10, which will touch on how Persona keeps pace with new threats and how Index made a prescient move to spot and back Persona early on. And we have Disrupt in San Francisco from September 19–21 — our annual conference is jam-packed with expert-led sessions and interviews with movers and shakers in the tech space.\\n\\nNow, with that out of the way, here’s the top headlines.\\n\\nmost read\\n\\nAmazon debuts free channels: Amazon is doubling down on free, ad-supported content with this week’s introduction of Fire TV Channels. The new, free and ad-supported video experience, which came to Fire TV devices this week, will be continuously updated throughout the day and integrated into several areas across the Fire TV interface, Sarah reports.\\n\\nBio update for a check: Briefly, a bug on Twitter let legacy blue check holders get their badge back by updating their bio. Readers will recall that blue checks on Twitter once signified that a user was “verified,” but now serve as an indication that they’re paying for Twitter’s premium subscription service, Twitter Blue. Verified users who chose not to pay recently faced the prospect of blue check removal — but not necessarily permanently, judging by the bug.\\n\\nGoogle ditches passwords for passkeys: This week Google rolled out passkeys to Google Account users globally, roughly a year after the company — alongside Apple, Microsoft and the FIDO Alliance — announced a partnership to broadly advance passkey adoption. With passkeys, users’ authentication synchronizes across devices through the cloud using cryptographic key pairs, allowing them to # to websites and apps using the same biometrics or screen-lock PIN they use to unlock their devices.\\n\\nMicrosoft debuts Pegasus: Microsoft this week announced that it’ll extend the Startup Founders Hub, its self-service platform that provides founders with free resources, including Azure credits, with a new incubator program called the Pegasus Program. Pegasus will select startups with products that “fill a market need” and give them up to $350,000 in Azure, GitHub and LinkedIn credits plus backing from advisors, as well as “access to the best Microsoft tech,” Microsoft says.\\n\\nBlue check marks come to Gmail: Google is going to start displaying a blue check mark next to select senders’ names on Gmail to verify their identity, the company said on Wednesday. The check marks will automatically appear next to companies that have adopted Gmail’s existing brand indicators for message identification feature, reports Aisha.\\n\\nOpenAI rakes in the dough: OpenAI, the startup behind the widely used conversational AI model ChatGPT, has picked up new backers. In an exclusive report, Jagmeet and Ingrid reveal that VC firms, including Sequoia Capital, Andreessen Horowitz, Thrive, K2 Global and Founders Fund, have put just over $300 million into OpenAI, valuing the company at between $27 billion and $29 billion.\\n\\nApple releases security fix: On Monday, Apple released its first batch of publicly available “rapid security” patches, aimed at quickly fixing security vulnerabilities that are under active exploitation or pose significant risks to its customers. Apple says that these patches, which are enabled by default, were intended to let customers update their devices faster than a typical software upgrade.\\n\\nMusk settles for less: A defamation case brought against Tesla chief executive Elon Musk by critic Randeep Hothi is coming to a close, reportedly costing the billionaire ten big ones. Lawyers representing Hothi — a vocal member of the TSLAQ short-seller community on Twitter who rose to prominence as a skeptic of Tesla’s gigafactory plans and “full self-driving” tech — said in a statement that Musk asked to settle the nearly three-year-old case back in March.', start_char_idx=0, end_char_idx=4452, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='486f2622-8502-46ef-a521-4b09ceacdcfa', embedding=None, metadata={'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='585e02c4-547e-4e23-8cb1-031f2f5b593e', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='0b3471866fbb75fe567aa7e5f850d608cc7dc775df7cc1ed95b5e26b5ba099f9'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='2ca21cfb-d277-41b1-8ec9-8549843e51de', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='06e3f5fc9ff74c0c47694e6f7a252ba6c39203dd973f28a57a25a6a5119932ad'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='751387da-bba3-457f-8bb5-b8b0a34a500c', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='7d90c3a8d66e55e2d828fcd3a9633eac65e08ed7909569a12bf5a7d48fd0d129')}, hash='244b928352908abd7262537ff30a2f5a6623dc79e06b5479eb119757d14521f7', text='We shouldn’t be unaware of those risk factors. We can, as we build applications, be prepared to detect excursions away from safe territory, so that we don’t accidentally inflict some harm by the use of these kinds of technologies.\\n\\nSo we need some kind of guardrails.\\n\\nAgain, I’m not expert in this space, but I am beginning to wonder whether we need something kind of like that in order to provide a “super-ego” for the natural language network. So when it starts to go off the rails somewhere, we can observe that that’s happening. And a second network that’s observing both the input and the output might intervene, somehow, and stop the the production of the output.\\n\\nSort of a conscience function?\\n\\nWell, it’s not quite conscience, it’s closer to executive function — the prefrontal cortex. I want to be careful, I’m only reasoning by metaphor here.\\n\\nI know that Microsoft has embarked on something like this. Their version of GPT-4 has an intermediary model like that, they call it Prometheus.\\n\\nPurely as an observation, I had the impression that the Prometheus natural language model would detect and intervene if it thought that the interactions were going down with dark path. I thought that they would implement it in such a way that before you actually say something to the interlocutor that is going down the dark path, you intervene and prevent it from going there at all.\\n\\nMy impression, though, is that it actually produces the output and then discovers that it’s produced it, but and then it says, “Oh, I shouldn’t have done that. Oh, dear, I take that back,” or “I don’t want to talk to you anymore about that.” It’s a little bit like the email that you get occasionally from the Microsoft Outlook system that says, “This person would like to withdraw the message.”\\n\\nI love when that happens… it makes me want to read the original message so badly, even if I wouldn’t have before.\\n\\nYeah, exactly. It’s sort of like putting a big red flag in there saying, boy there’s something juicy in here.\\n\\nYou mentioned the AI models, that it’s an interesting place to work. Do you get the same sort of foundational flavor that you got from working on protocols and other big shared things over the years?\\n\\nWell, what we are seeing is emergent properties of these large language models, that are not necessarily anticipated. And there have been emergent properties showing up in the protocol world. Flow control in particular is a vast headache in the online packet switch environment, and people have been tackling these problems inside and outside of Google for years.\\n\\nOne of the examples of emergent properties that I think very few of us thought about is the domain name business. Once they had value, suddenly, all kinds of emergent properties show up, people with interests that conflict and have to be resolved. Same for internet address space, it’s an even more weird environment where people actually buy IPv4 addresses for like $50 each.\\n\\nI confess to you that as I watched the auctions for IPv4 address space, I was thinking how stupid I was. When I was at the Defense Department in charge of all this, I should have allocated the slash eight, which is 16 million addresses, to myself, and just sit on it, you know, for 50 years, then sell it and retire.\\n\\nEven simple systems have the ability to surprise you. Especially when you have simple systems when a large number of them are interacting with each other. I’ve found myself not necessarily recognizing when these emergent properties will come, but I will say that whenever something gets monetized, you should anticipate there will be emergent properties and possibly unexpected behavior, all driven by greed.\\n\\nLet me ask you about some some other stuff you’re working on. I’m always happy when I see cutting-edge tech being applied to people who need it, people with disabilities, people who like just have not been addressed by the current use cases of tech. Are you still working in the accessibility community?\\n\\nI am very active in the accessibility space. At Google, we have a number of what we call employee resource groups, or ERGs. Yeah, some of them I, executive sponsor for one for Googlers who have hearing problems. And there is a disabilities oriented group, which involves employees who either have disabilities or family members that have disabilities, and they share their stories with each other because often people have similar problems, but don’t know what the solutions were for other people. Also, it’s just nice to know that you’re not alone in some of these challenges.', start_char_idx=3418, end_char_idx=7982, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='58ffa359-9bd5-44a8-b6b8-66ba9193b871', embedding=None, metadata={'file_path': 'data/new_articles/05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_name': '05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_type': 'text/plain', 'file_size': 6391, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='305009c8-c719-42a1-93d1-4f19be2cda3e', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_name': '05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_type': 'text/plain', 'file_size': 6391, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='2b4fe84222f3e3dbb980361dff28403ea80dc2df66b9244ec58220cc480f1691'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='329b872c-a754-4678-9e4f-e45ea2c599e6', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_name': '05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_type': 'text/plain', 'file_size': 6391, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='26da7eb1863597d54e57f94037fd69905cb3e719426f2bc7a920ddda08aba8d7'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='3a72f9ee-4f64-401c-b98e-81f515a4f372', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='be8679566a26b9afadf5e27136a32c1ce300224bba75187972b7eaa9f5dcbb35')}, hash='bc6cfa312c08abf8c369abd9f93dcd2f2209228f68e3e4c9b51507fa8aa61079', text='For a business like OpenAI, its jockey Microsoft, Google or anyone else in the AI-as-a-service world, it effectively beggars the entire premise of their business: that these systems are so hard to build and run that they have to do it for you. In fact it starts to look like these companies picked and engineered a version of AI that fit their existing business model, not vice versa!\\n\\nOnce upon a time you had to offload the computation involved in word processing to a mainframe — your terminal was just a display. Of course that was a different era, and we’ve long since been able to fit the whole application on a personal computer. That process has occurred many times since as our devices have repeatedly and exponentially increased their capacity for computation. These days when something has to be done on a supercomputer, everyone understands that it’s just a matter of time and optimization.\\n\\nFor Google and OpenAI, the time came a lot quicker than expected. And they weren’t the ones to do the optimizing — and may never be at this rate.\\n\\nNow, that doesn’t mean that they’re plain out of luck. Google didn’t get where it is by being the best — not for a long time, anyway. Being a Walmart has its benefits. Companies don’t want to have to find the bespoke solution that performs the task they want 30% faster if they can get a decent price from their existing vendor and not rock the boat too much. Never underestimate the value of inertia in business!\\n\\nSure, people are iterating on LLaMA so fast that they’re running out of camelids to name them after. Incidentally, I’d like to thank the developers for an excuse to just scroll through hundreds of pictures of cute, tawny vicuñas instead of working. But few enterprise IT departments are going to cobble together an implementation of Stability’s open source derivative-in-progress of a quasi-legal leaked Meta model over OpenAI’s simple, effective API. They’ve got a business to run!\\n\\nBut at the same time, I stopped using Photoshop years ago for image editing and creation because the open source options like Gimp and Paint.net have gotten so incredibly good. At this point, the argument goes the other direction. Pay how much for Photoshop? No way, we’ve got a business to run!\\n\\nWhat Google’s anonymous authors are clearly worried about is that the distance from the first situation to the second is going to be much shorter than anyone thought, and there doesn’t appear to be a damn thing anybody can do about it.\\n\\nExcept, the memo argues: embrace it. Open up, publish, collaborate, share, compromise. As they conclude:', start_char_idx=3716, end_char_idx=6304, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='2ca21cfb-d277-41b1-8ec9-8549843e51de', embedding=None, metadata={'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={<NodeRelationship.SOURCE: '1'>: RelatedNodeInfo(node_id='585e02c4-547e-4e23-8cb1-031f2f5b593e', node_type=<ObjectType.DOCUMENT: '4'>, metadata={'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='0b3471866fbb75fe567aa7e5f850d608cc7dc775df7cc1ed95b5e26b5ba099f9'), <NodeRelationship.PREVIOUS: '2'>: RelatedNodeInfo(node_id='c6ae69dc-eb17-4fc9-aeb2-cb780e623726', node_type=<ObjectType.TEXT: '1'>, metadata={'file_path': 'data/new_articles/05-05-google-i-o-2023-is-next-week-heres-what-were-expecting.txt', 'file_name': '05-05-google-i-o-2023-is-next-week-heres-what-were-expecting.txt', 'file_type': 'text/plain', 'file_size': 7917, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, hash='57926d2fa36765fbdb175ead91f00ef28556a4419fbffcc61828e6f7c32fb966'), <NodeRelationship.NEXT: '3'>: RelatedNodeInfo(node_id='486f2622-8502-46ef-a521-4b09ceacdcfa', node_type=<ObjectType.TEXT: '1'>, metadata={}, hash='08c05e5c76154a0690141462250ab5089deaddcf2c7ec766083eb95e4db193b3')}, hash='eb00c186d3c5e5440129d403fde1d19378a55407102092397662731d37728b47', text=\"Vint Cerf on the ‘exhilarating mix’ of thrill and hazard at the frontiers of tech 'That's always an exciting place to be — a place where nobody's ever been before.'\\n\\nVint Cerf has been a near-constant influence on the internet since the days when he was helping create it in the first place. Today he wears many hats, among them VP and chief internet evangelist at Google. He is to be awarded the IEEE’s Medal of Honor at a gala in Atlanta, and ahead of the occasion he spoke with TechCrunch in a wide-ranging interview touching on his work, AI, accessibility and interplanetary internet.\\n\\nTechCrunch: To start out with, can you tell us how Google has changed in your time there?\\n\\nCerf: Well, when I joined the company in 2005, there were 5,000 people already, which is pretty damn big. And of course, my normal attire is three piece suits. The important thing is that I thought I would be raising the sartorial quotient of the company by joining. And now, almost 18 years later, there are 170-some-odd thousand people, and I have failed miserably. So I hope you don’t mind if I take my jacket off.\\n\\nGo right ahead.\\n\\nSo as you might have noticed, Sergey has come back to do a little bit more on the artificial intelligence side of things, which is something he’s always been interested in; I would say historically, we’ve always had an interest in artificial intelligence. But that has escalated significantly over the past decade or so. The acquisition of DeepMind was a brilliant choice. And you can see some of the outcomes first of the spectacular stuff, like playing Go and winning. And then the more productive stuff, like figuring out how 200 million proteins are folded up.\\n\\nThen there’s the large language models and the chatbots. And I think we’re still in a very peculiar period of time, where we’re trying to characterize what these things can and can’t do, and how they go off the rails, and how do you take advantage of them to do useful work? How do we get them to distinguish fact from fiction? All of that is in my view open territory, but then that’s always an exciting place to be — a place where nobody’s ever been before. The thrill of discovery and the risk of hazard create a fairly exciting mix — an exhilarating mix.\\n\\nYou gave a talk recently about, I don’t want to say the dangers of the large language models, but…\\n\\nWell, I did say there are hazards there. I was talking to a bunch of investment bankers, or VCs, and I said, you know, don’t try to sell stuff to your investors just because it’s flashy and shiny. Be cautious about going too fast and trying to apply it without figuring out how to put guardrails in place.\\n\\nI raised a question of hazard and wanting people to be more thoughtful about which applications made sense. I even suggested an analogy: you know how the Society of Automotive Engineers, they have different risk levels for the self driving cars — a risk level idea could apply to artificial intelligence and machine learning.\\n\\nFor entertainment purposes, perhaps it’s not too concerning, unless it goes down some dark path, in which case, you might want to put some friction into the system to deal with that, especially a younger user. But then, as you get to the point where you’re training these things to do medical diagnosis or make investment advice, or make decisions about whether somebody gets out of jail… now suddenly, the risk factors are extremely high.\\n\\nWe shouldn’t be unaware of those risk factors. We can, as we build applications, be prepared to detect excursions away from safe territory, so that we don’t accidentally inflict some harm by the use of these kinds of technologies.\\n\\nSo we need some kind of guardrails.\\n\\nAgain, I’m not expert in this space, but I am beginning to wonder whether we need something kind of like that in order to provide a “super-ego” for the natural language network. So when it starts to go off the rails somewhere, we can observe that that’s happening. And a second network that’s observing both the input and the output might intervene, somehow, and stop the the production of the output.\\n\\nSort of a conscience function?\\n\\nWell, it’s not quite conscience, it’s closer to executive function — the prefrontal cortex. I want to be careful, I’m only reasoning by metaphor here.\\n\\nI know that Microsoft has embarked on something like this.\", start_char_idx=0, end_char_idx=4332, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0), NodeWithScore(node=TextNode(id_='15cd96d5-0183-4e24-81c7-58ad0974fa7e', embedding=None, metadata={'kg_rel_texts': [\"('Bing Chat', 'is getting', 'plugins from partners like OpenTable and Wolfram Alpha')\", \"('Bing Chat', 'creating charts and graphs', 'when fed the right prompt and data')\", \"('Actions', 'translate', 'Bing Chat prompts into automations')\", '(\\'Microsoft\\', \\'integrates\\', \"OpenAI\\'s GPT-4 model into Bing\")', \"['AI', 'used to generate', 'ad and marketing copy']\", \"('Bing', 'heavily revolves around', 'AI')\", \"['AI', 'hot as', 'sun']\"], 'kg_rel_map': {'AI': [['AI', 'used to generate', 'ad and marketing copy'], ['AI', 'hot as', 'sun']], 'bing': []}}, excluded_embed_metadata_keys=['kg_rel_map', 'kg_rel_texts'], excluded_llm_metadata_keys=['kg_rel_map', 'kg_rel_texts'], relationships={}, hash='91080d1bc3bf30e2aafaa23999bf77233fef0a687e7f9d347aa2f72c87982a45', text='The following are knowledge sequence in max depth 2 in the form of directed graph like:\\n`subject -[predicate]->, object, <-[predicate_next_hop]-, object_next_hop ...`\\n(\\'Bing Chat\\', \\'is getting\\', \\'plugins from partners like OpenTable and Wolfram Alpha\\')\\n(\\'Bing Chat\\', \\'creating charts and graphs\\', \\'when fed the right prompt and data\\')\\n(\\'Actions\\', \\'translate\\', \\'Bing Chat prompts into automations\\')\\n(\\'Microsoft\\', \\'integrates\\', \"OpenAI\\'s GPT-4 model into Bing\")\\n[\\'AI\\', \\'used to generate\\', \\'ad and marketing copy\\']\\n(\\'Bing\\', \\'heavily revolves around\\', \\'AI\\')\\n[\\'AI\\', \\'hot as\\', \\'sun\\']', start_char_idx=None, end_char_idx=None, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=1000.0)], metadata={'058565bf-18c7-4ea2-9b39-826837364a15': {'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '7f13f2e3-92e4-4427-9388-984f2b70a1d8': {'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, 'fd853620-602b-4514-811f-591e690c6737': {'file_path': 'data/new_articles/05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_name': '05-04-microsoft-doubles-down-on-ai-with-new-bing-features.txt', 'file_type': 'text/plain', 'file_size': 11643, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '2f8c1725-312f-420e-883c-7333302e9807': {'file_path': 'data/new_articles/05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_name': '05-06-this-week-in-apps-apple-and-google-team-up-on-trackers-google-i-o-preview-apps-hit-newfronts.txt', 'file_type': 'text/plain', 'file_size': 28949, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '4b8faaab-4d04-4bad-8a2c-490f95c4d863': {'file_path': 'data/new_articles/05-06-ai-startups-q1-investments.txt', 'file_name': '05-06-ai-startups-q1-investments.txt', 'file_type': 'text/plain', 'file_size': 1475, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, 'c6e51e31-ad06-4192-8eda-0adc25a8e731': {'file_path': 'data/new_articles/05-03-chatgpt-everything-you-need-to-know-about-the-ai-powered-chatbot.txt', 'file_name': '05-03-chatgpt-everything-you-need-to-know-about-the-ai-powered-chatbot.txt', 'file_type': 'text/plain', 'file_size': 18062, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '9a47b2d5-e1a8-42b9-bb09-6e73ec4ae43d': {'file_path': 'data/new_articles/05-06-amazon-launches-free-channels-check-marks-come-to-gmail-and-openai-raises-more-moolah.txt', 'file_name': '05-06-amazon-launches-free-channels-check-marks-come-to-gmail-and-openai-raises-more-moolah.txt', 'file_type': 'text/plain', 'file_size': 7890, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '486f2622-8502-46ef-a521-4b09ceacdcfa': {'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '58ffa359-9bd5-44a8-b6b8-66ba9193b871': {'file_path': 'data/new_articles/05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_name': '05-05-google-and-openai-are-walmarts-besieged-by-fruit-stands.txt', 'file_type': 'text/plain', 'file_size': 6391, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '2ca21cfb-d277-41b1-8ec9-8549843e51de': {'file_path': 'data/new_articles/05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_name': '05-05-vint-cerf-on-the-exhilarating-mix-of-thrill-and-hazard-at-the-frontiers-of-tech.txt', 'file_type': 'text/plain', 'file_size': 16941, 'creation_date': '2024-01-08', 'last_modified_date': '2023-05-08', 'last_accessed_date': '2024-01-08'}, '15cd96d5-0183-4e24-81c7-58ad0974fa7e': {'kg_rel_texts': [\"('Bing Chat', 'is getting', 'plugins from partners like OpenTable and Wolfram Alpha')\", \"('Bing Chat', 'creating charts and graphs', 'when fed the right prompt and data')\", \"('Actions', 'translate', 'Bing Chat prompts into automations')\", '(\\'Microsoft\\', \\'integrates\\', \"OpenAI\\'s GPT-4 model into Bing\")', \"['AI', 'used to generate', 'ad and marketing copy']\", \"('Bing', 'heavily revolves around', 'AI')\", \"['AI', 'hot as', 'sun']\"], 'kg_rel_map': {'AI': [['AI', 'used to generate', 'ad and marketing copy'], ['AI', 'hot as', 'sun']], 'bing': []}}})"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "query = \"What is bing AI ?\"\n",
    "\n",
    "message_template =f\"\"\"<|system|>Please check if the following pieces of context has any mention of the  keywords provided in the Question.If not then don't know the answer, just say that you don't know.Stop there.Please donot try to make up an answer.</s>\n",
    "<|user|>\n",
    "Question: {query}\n",
    "Helpful Answer:\n",
    "</s>\"\"\"\n",
    "\n",
    "response = query_engine.query(query)\n",
    "response"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Graph Visualizations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "./vis/03/graph.html\n"
     ]
    }
   ],
   "source": [
    "g = kg_index.get_networkx_graph()\n",
    "net = Network(\n",
    "            notebook=True,\n",
    "            cdn_resources=\"in_line\",\n",
    "            directed=True\n",
    "            )\n",
    "net.from_nx(g)\n",
    "net.show(\"./vis/03/graph.html\")\n",
    "net.save_graph(\"./vis/03/Knowledge_graph.html\")"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "llamaindex",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.18"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}