JSONiq-tutorial-3.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "80b4ef60",
   "metadata": {},
   "source": [
    "# Big Data HS 2024\n",
    "\n",
    "## JSONiq tutorial - week 3"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0d21726b",
   "metadata": {},
   "source": [
    "This is the JSONiq tutorial for week 3.\n",
    "\n",
    "Do not forget to use localhost:8888 as the URL to make sure the notebook is accessed via docker! And if it does not work, you should delete all containers, images, and volumes, then try again with\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "469ccebf",
   "metadata": {},
   "source": [
    "````\n",
    "docker-compose up\n",
    "````"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7fa4dd13",
   "metadata": {},
   "source": [
    "Like last week, junst run the cell below to connect the Jupyter notebook with RumbleDB."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "id": "49147176",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The rumbledb extension is already loaded. To reload it, use:\n",
      "  %reload_ext rumbledb\n",
      "env: RUMBLEDB_SERVER=http://rumble:9090/jsoniq\n"
     ]
    }
   ],
   "source": [
    "%load_ext rumbledb\n",
    "%env RUMBLEDB_SERVER=http://rumble:9090/jsoniq"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b92a4859",
   "metadata": {},
   "source": [
    "## Reading a text file\n",
    "\n",
    "This week, we will learn how to read some data, starting with text files.\n",
    "\n",
    "Download the text file (The start of Hamlet, by Shakespeare) from [this location](https://www.rumbledb.org/samples/hamlet.txt) and copy it into the notebooks folder, besides this tutorial file. Rename it to hamlet.txt"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "05f22856",
   "metadata": {},
   "source": [
    "Now, you can open it with:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "id": "8dd8206b",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.03293776512145996 ms\n",
      "\"Hamlet\\nby William Shakespeare\\nEdited by Barbara A. Mowat and Paul Werstine\\n  with Michael Poston and Rebecca Niles\\nFolger Shakespeare Library\\nhttps://shakespeare.folger.edu/shakespeares-works/hamlet/\\nCreated on Jul 31, 2015, from FDT version 0.9.2\\n\\nCharacters in the Play\\n======================\\nTHE GHOST\\nHAMLET, Prince of Denmark, son of the late King Hamlet and Queen Gertrude\\nQUEEN GERTRUDE, widow of King Hamlet, now married to Claudius\\nKING CLAUDIUS, brother to the late King Hamlet\\nOPHELIA\\nLAERTES, her brother\\nPOLONIUS, father of Ophelia and Laertes, councillor to King Claudius\\nREYNALDO, servant to Polonius\\nHORATIO, Hamlet's friend and confidant\\nCourtiers at the Danish court:\\n  VOLTEMAND\\n  CORNELIUS\\n  ROSENCRANTZ\\n  GUILDENSTERN\\n  OSRIC\\n  Gentlemen\\n  A Lord\\nDanish soldiers:\\n  FRANCISCO\\n  BARNARDO\\n  MARCELLUS\\nFORTINBRAS, Prince of Norway\\nA Captain in Fortinbras's army\\nAmbassadors to Denmark from England\\nPlayers who take the roles of Prologue, Player King, Player Queen, and Lucianus in <title>The Murder of Gonzago</title>\\nTwo Messengers\\nSailors\\nGravedigger\\nGravedigger's companion\\nDoctor of Divinity\\nAttendants, Lords, Guards, Musicians, Laertes's Followers, Soldiers, Officers\\n\\n\\nACT 1\\n=====\\n\\nScene 1\\n=======\\n[Enter Barnardo and Francisco, two sentinels.]\\n\\n\\nBARNARDO  Who's there?\\n\\nFRANCISCO\\nNay, answer me. Stand and unfold yourself.\\n\\nBARNARDO  Long live the King!\\n\\nFRANCISCO  Barnardo?\\n\\nBARNARDO  He.\\n\\nFRANCISCO\\nYou come most carefully upon your hour.\\n\\nBARNARDO\\n'Tis now struck twelve. Get thee to bed, Francisco.\\n\\nFRANCISCO\\nFor this relief much thanks. 'Tis bitter cold,\\nAnd I am sick at heart.\\n\\nBARNARDO  Have you had quiet guard?\\n\\nFRANCISCO  Not a mouse stirring.\\n\\nBARNARDO  Well, good night.\\nIf you do meet Horatio and Marcellus,\\nThe rivals of my watch, bid them make haste.\\n\\n[Enter Horatio and Marcellus.]\\n\\n\\nFRANCISCO\\nI think I hear them.--Stand ho! Who is there?\\n\\nHORATIO  Friends to this ground.\\n\\nMARCELLUS  And liegemen to the Dane.\\n\\nFRANCISCO  Give you good night.\\n\\nMARCELLUS\\nO farewell, honest soldier. Who hath relieved\\nyou?\\n\\nFRANCISCO\\nBarnardo hath my place. Give you good night.\\n[Francisco exits.]\\n\\nMARCELLUS  Holla, Barnardo.\\n\\nBARNARDO  Say, what, is Horatio there?\\n\\nHORATIO  A piece of him.\\n\\nBARNARDO\\nWelcome, Horatio.--Welcome, good Marcellus.\\n\\nHORATIO\\nWhat, has this thing appeared again tonight?\\n\\nBARNARDO  I have seen nothing.\\n\\nMARCELLUS\\nHoratio says 'tis but our fantasy\\nAnd will not let belief take hold of him\\nTouching this dreaded sight twice seen of us.\\nTherefore I have entreated him along\\nWith us to watch the minutes of this night,\\nThat, if again this apparition come,\\nHe may approve our eyes and speak to it.\\n\\nHORATIO\\nTush, tush, 'twill not appear.\\n\\nBARNARDO  Sit down awhile,\\nAnd let us once again assail your ears,\\nThat are so fortified against our story,\\nWhat we have two nights seen.\\n\\nHORATIO  Well, sit we down,\\nAnd let us hear Barnardo speak of this.\\n\\nBARNARDO  Last night of all,\\nWhen yond same star that's westward from the pole\\nHad made his course t' illume that part of heaven\\nWhere now it burns, Marcellus and myself,\\nThe bell then beating one--\\n\\n[Enter Ghost.]\\n\\n\\nMARCELLUS\\nPeace, break thee off! Look where it comes again.\\n\\nBARNARDO\\nIn the same figure like the King that's dead.\\n\\nMARCELLUS, [to Horatio]\\nThou art a scholar. Speak to it, Horatio.\\n\\nBARNARDO\\nLooks he not like the King? Mark it, Horatio.\\n\\nHORATIO\\nMost like. It harrows me with fear and wonder.\\n\\nBARNARDO\\nIt would be spoke to.\\n\\nMARCELLUS  Speak to it, Horatio.\\n\\nHORATIO\\nWhat art thou that usurp'st this time of night,\\nTogether with that fair and warlike form\\nIn which the majesty of buried Denmark\\nDid sometimes march? By heaven, I charge thee,\\nspeak.\\n\\nMARCELLUS\\nIt is offended.\\n\\nBARNARDO  See, it stalks away.\\n\\nHORATIO\\nStay! speak! speak! I charge thee, speak!\\n[Ghost exits.]\\n\\nMARCELLUS  'Tis gone and will not answer.\\n\\nBARNARDO\\nHow now, Horatio, you tremble and look pale.\\nIs not this something more than fantasy?\\nWhat think you on 't?\\n\\nHORATIO\\nBefore my God, I might not this believe\\nWithout the sensible and true avouch\\nOf mine own eyes.\\n\\nMARCELLUS  Is it not like the King?\\n\\nHORATIO  As thou art to thyself.\\nSuch was the very armor he had on\\nWhen he the ambitious Norway combated.\\nSo frowned he once when, in an angry parle,\\nHe smote the sledded Polacks on the ice.\\n'Tis strange.\\n\"\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "unparsed-text(\"hamlet.txt\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6f15cbe6",
   "metadata": {},
   "source": [
    "The query above returned the contents of the text file as a single (big) string. This is very declarative, is it not?\n",
    "\n",
    "By the way, RumbleDB can also directly get the file from the Web:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "id": "d2b4da4c",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.16814541816711426 ms\n",
      "\"Hamlet\\nby William Shakespeare\\nEdited by Barbara A. Mowat and Paul Werstine\\n  with Michael Poston and Rebecca Niles\\nFolger Shakespeare Library\\nhttps://shakespeare.folger.edu/shakespeares-works/hamlet/\\nCreated on Jul 31, 2015, from FDT version 0.9.2\\n\\nCharacters in the Play\\n======================\\nTHE GHOST\\nHAMLET, Prince of Denmark, son of the late King Hamlet and Queen Gertrude\\nQUEEN GERTRUDE, widow of King Hamlet, now married to Claudius\\nKING CLAUDIUS, brother to the late King Hamlet\\nOPHELIA\\nLAERTES, her brother\\nPOLONIUS, father of Ophelia and Laertes, councillor to King Claudius\\nREYNALDO, servant to Polonius\\nHORATIO, Hamlet's friend and confidant\\nCourtiers at the Danish court:\\n  VOLTEMAND\\n  CORNELIUS\\n  ROSENCRANTZ\\n  GUILDENSTERN\\n  OSRIC\\n  Gentlemen\\n  A Lord\\nDanish soldiers:\\n  FRANCISCO\\n  BARNARDO\\n  MARCELLUS\\nFORTINBRAS, Prince of Norway\\nA Captain in Fortinbras's army\\nAmbassadors to Denmark from England\\nPlayers who take the roles of Prologue, Player King, Player Queen, and Lucianus in <title>The Murder of Gonzago</title>\\nTwo Messengers\\nSailors\\nGravedigger\\nGravedigger's companion\\nDoctor of Divinity\\nAttendants, Lords, Guards, Musicians, Laertes's Followers, Soldiers, Officers\\n\\n\\nACT 1\\n=====\\n\\nScene 1\\n=======\\n[Enter Barnardo and Francisco, two sentinels.]\\n\\n\\nBARNARDO  Who's there?\\n\\nFRANCISCO\\nNay, answer me. Stand and unfold yourself.\\n\\nBARNARDO  Long live the King!\\n\\nFRANCISCO  Barnardo?\\n\\nBARNARDO  He.\\n\\nFRANCISCO\\nYou come most carefully upon your hour.\\n\\nBARNARDO\\n'Tis now struck twelve. Get thee to bed, Francisco.\\n\\nFRANCISCO\\nFor this relief much thanks. 'Tis bitter cold,\\nAnd I am sick at heart.\\n\\nBARNARDO  Have you had quiet guard?\\n\\nFRANCISCO  Not a mouse stirring.\\n\\nBARNARDO  Well, good night.\\nIf you do meet Horatio and Marcellus,\\nThe rivals of my watch, bid them make haste.\\n\\n[Enter Horatio and Marcellus.]\\n\\n\\nFRANCISCO\\nI think I hear them.--Stand ho! Who is there?\\n\\nHORATIO  Friends to this ground.\\n\\nMARCELLUS  And liegemen to the Dane.\\n\\nFRANCISCO  Give you good night.\\n\\nMARCELLUS\\nO farewell, honest soldier. Who hath relieved\\nyou?\\n\\nFRANCISCO\\nBarnardo hath my place. Give you good night.\\n[Francisco exits.]\\n\\nMARCELLUS  Holla, Barnardo.\\n\\nBARNARDO  Say, what, is Horatio there?\\n\\nHORATIO  A piece of him.\\n\\nBARNARDO\\nWelcome, Horatio.--Welcome, good Marcellus.\\n\\nHORATIO\\nWhat, has this thing appeared again tonight?\\n\\nBARNARDO  I have seen nothing.\\n\\nMARCELLUS\\nHoratio says 'tis but our fantasy\\nAnd will not let belief take hold of him\\nTouching this dreaded sight twice seen of us.\\nTherefore I have entreated him along\\nWith us to watch the minutes of this night,\\nThat, if again this apparition come,\\nHe may approve our eyes and speak to it.\\n\\nHORATIO\\nTush, tush, 'twill not appear.\\n\\nBARNARDO  Sit down awhile,\\nAnd let us once again assail your ears,\\nThat are so fortified against our story,\\nWhat we have two nights seen.\\n\\nHORATIO  Well, sit we down,\\nAnd let us hear Barnardo speak of this.\\n\\nBARNARDO  Last night of all,\\nWhen yond same star that's westward from the pole\\nHad made his course t' illume that part of heaven\\nWhere now it burns, Marcellus and myself,\\nThe bell then beating one--\\n\\n[Enter Ghost.]\\n\\n\\nMARCELLUS\\nPeace, break thee off! Look where it comes again.\\n\\nBARNARDO\\nIn the same figure like the King that's dead.\\n\\nMARCELLUS, [to Horatio]\\nThou art a scholar. Speak to it, Horatio.\\n\\nBARNARDO\\nLooks he not like the King? Mark it, Horatio.\\n\\nHORATIO\\nMost like. It harrows me with fear and wonder.\\n\\nBARNARDO\\nIt would be spoke to.\\n\\nMARCELLUS  Speak to it, Horatio.\\n\\nHORATIO\\nWhat art thou that usurp'st this time of night,\\nTogether with that fair and warlike form\\nIn which the majesty of buried Denmark\\nDid sometimes march? By heaven, I charge thee,\\nspeak.\\n\\nMARCELLUS\\nIt is offended.\\n\\nBARNARDO  See, it stalks away.\\n\\nHORATIO\\nStay! speak! speak! I charge thee, speak!\\n[Ghost exits.]\\n\\nMARCELLUS  'Tis gone and will not answer.\\n\\nBARNARDO\\nHow now, Horatio, you tremble and look pale.\\nIs not this something more than fantasy?\\nWhat think you on 't?\\n\\nHORATIO\\nBefore my God, I might not this believe\\nWithout the sensible and true avouch\\nOf mine own eyes.\\n\\nMARCELLUS  Is it not like the King?\\n\\nHORATIO  As thou art to thyself.\\nSuch was the very armor he had on\\nWhen he the ambitious Norway combated.\\nSo frowned he once when, in an angry parle,\\nHe smote the sledded Polacks on the ice.\\n'Tis strange.\\n\"\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "unparsed-text(\"https://www.rumbledb.org/samples/hamlet.txt\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3280f7dd",
   "metadata": {},
   "source": [
    "## String functions\n",
    "\n",
    "Now let us look into a few useful string functions. JSONiq has quite a large library of builtin functions.\n",
    "\n",
    "One of them, contains() tests whether the first string contains the second one. For example, it is not surprising that our text file contains the substring \"Hamlet\":"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "id": "de5eaff7",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.15789794921875 ms\n",
      "true\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "contains(unparsed-text(\"https://www.rumbledb.org/samples/hamlet.txt\"), \"Hamlet\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9df87ef6",
   "metadata": {},
   "source": [
    "It is perhaps also not surprising that it does not contain the substring \"Bitcoin\". By the way, let us now use a variable to store our document:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "id": "d20c0d55",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.1603989601135254 ms\n",
      "false\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "let $doc := unparsed-text(\"https://www.rumbledb.org/samples/hamlet.txt\")\n",
    "return contains($doc, \"Bitcoin\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a661049e",
   "metadata": {},
   "source": [
    "The function starts-with() tests whether the first string starts with the second one:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "id": "366a92aa",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.15949177742004395 ms\n",
      "true\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "let $doc := unparsed-text(\"https://www.rumbledb.org/samples/hamlet.txt\")\n",
    "return starts-with($doc, \"Hamlet\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ab9006e5",
   "metadata": {},
   "source": [
    "And ends-with() tests whether the first string ends with the second one:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "id": "a7ebbfc3",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.23435449600219727 ms\n",
      "false\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "let $doc := unparsed-text(\"https://www.rumbledb.org/samples/hamlet.txt\")\n",
    "return ends-with($doc, \"Who is there?\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "98b8d2f4",
   "metadata": {},
   "source": [
    "## Opening a file as a sequence of strings\n",
    "\n",
    "Now, let us start showing the superpowers of JSONiq. Like SQL (who handles tables as large sets of records), JSONiq can handle large collections in so-called sequences.\n",
    "\n",
    "The function unparsed-text-lines() returns a sequence of strings, rather than a single string, like so:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "id": "bb655f40",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.22789406776428223 ms\n",
      "\"Hamlet\"\n",
      "\"by William Shakespeare\"\n",
      "\"Edited by Barbara A. Mowat and Paul Werstine\"\n",
      "\"  with Michael Poston and Rebecca Niles\"\n",
      "\"Folger Shakespeare Library\"\n",
      "\"https://shakespeare.folger.edu/shakespeares-works/hamlet/\"\n",
      "\"Created on Jul 31, 2015, from FDT version 0.9.2\"\n",
      "\"\"\n",
      "\"Characters in the Play\"\n",
      "\"======================\"\n",
      "\"THE GHOST\"\n",
      "\"HAMLET, Prince of Denmark, son of the late King Hamlet and Queen Gertrude\"\n",
      "\"QUEEN GERTRUDE, widow of King Hamlet, now married to Claudius\"\n",
      "\"KING CLAUDIUS, brother to the late King Hamlet\"\n",
      "\"OPHELIA\"\n",
      "\"LAERTES, her brother\"\n",
      "\"POLONIUS, father of Ophelia and Laertes, councillor to King Claudius\"\n",
      "\"REYNALDO, servant to Polonius\"\n",
      "\"HORATIO, Hamlet's friend and confidant\"\n",
      "\"Courtiers at the Danish court:\"\n",
      "\"  VOLTEMAND\"\n",
      "\"  CORNELIUS\"\n",
      "\"  ROSENCRANTZ\"\n",
      "\"  GUILDENSTERN\"\n",
      "\"  OSRIC\"\n",
      "\"  Gentlemen\"\n",
      "\"  A Lord\"\n",
      "\"Danish soldiers:\"\n",
      "\"  FRANCISCO\"\n",
      "\"  BARNARDO\"\n",
      "\"  MARCELLUS\"\n",
      "\"FORTINBRAS, Prince of Norway\"\n",
      "\"A Captain in Fortinbras's army\"\n",
      "\"Ambassadors to Denmark from England\"\n",
      "\"Players who take the roles of Prologue, Player King, Player Queen, and Lucianus in <title>The Murder of Gonzago</title>\"\n",
      "\"Two Messengers\"\n",
      "\"Sailors\"\n",
      "\"Gravedigger\"\n",
      "\"Gravedigger's companion\"\n",
      "\"Doctor of Divinity\"\n",
      "\"Attendants, Lords, Guards, Musicians, Laertes's Followers, Soldiers, Officers\"\n",
      "\"\"\n",
      "\"\"\n",
      "\"ACT 1\"\n",
      "\"=====\"\n",
      "\"\"\n",
      "\"Scene 1\"\n",
      "\"=======\"\n",
      "\"[Enter Barnardo and Francisco, two sentinels.]\"\n",
      "\"\"\n",
      "\"\"\n",
      "\"BARNARDO  Who's there?\"\n",
      "\"\"\n",
      "\"FRANCISCO\"\n",
      "\"Nay, answer me. Stand and unfold yourself.\"\n",
      "\"\"\n",
      "\"BARNARDO  Long live the King!\"\n",
      "\"\"\n",
      "\"FRANCISCO  Barnardo?\"\n",
      "\"\"\n",
      "\"BARNARDO  He.\"\n",
      "\"\"\n",
      "\"FRANCISCO\"\n",
      "\"You come most carefully upon your hour.\"\n",
      "\"\"\n",
      "\"BARNARDO\"\n",
      "\"'Tis now struck twelve. Get thee to bed, Francisco.\"\n",
      "\"\"\n",
      "\"FRANCISCO\"\n",
      "\"For this relief much thanks. 'Tis bitter cold,\"\n",
      "\"And I am sick at heart.\"\n",
      "\"\"\n",
      "\"BARNARDO  Have you had quiet guard?\"\n",
      "\"\"\n",
      "\"FRANCISCO  Not a mouse stirring.\"\n",
      "\"\"\n",
      "\"BARNARDO  Well, good night.\"\n",
      "\"If you do meet Horatio and Marcellus,\"\n",
      "\"The rivals of my watch, bid them make haste.\"\n",
      "\"\"\n",
      "\"[Enter Horatio and Marcellus.]\"\n",
      "\"\"\n",
      "\"\"\n",
      "\"FRANCISCO\"\n",
      "\"I think I hear them.--Stand ho! Who is there?\"\n",
      "\"\"\n",
      "\"HORATIO  Friends to this ground.\"\n",
      "\"\"\n",
      "\"MARCELLUS  And liegemen to the Dane.\"\n",
      "\"\"\n",
      "\"FRANCISCO  Give you good night.\"\n",
      "\"\"\n",
      "\"MARCELLUS\"\n",
      "\"O farewell, honest soldier. Who hath relieved\"\n",
      "\"you?\"\n",
      "\"\"\n",
      "\"FRANCISCO\"\n",
      "\"Barnardo hath my place. Give you good night.\"\n",
      "\"[Francisco exits.]\"\n",
      "\"\"\n",
      "\"MARCELLUS  Holla, Barnardo.\"\n",
      "\"\"\n",
      "\"BARNARDO  Say, what, is Horatio there?\"\n",
      "\"\"\n",
      "\"HORATIO  A piece of him.\"\n",
      "\"\"\n",
      "\"BARNARDO\"\n",
      "\"Welcome, Horatio.--Welcome, good Marcellus.\"\n",
      "\"\"\n",
      "\"HORATIO\"\n",
      "\"What, has this thing appeared again tonight?\"\n",
      "\"\"\n",
      "\"BARNARDO  I have seen nothing.\"\n",
      "\"\"\n",
      "\"MARCELLUS\"\n",
      "\"Horatio says 'tis but our fantasy\"\n",
      "\"And will not let belief take hold of him\"\n",
      "\"Touching this dreaded sight twice seen of us.\"\n",
      "\"Therefore I have entreated him along\"\n",
      "\"With us to watch the minutes of this night,\"\n",
      "\"That, if again this apparition come,\"\n",
      "\"He may approve our eyes and speak to it.\"\n",
      "\"\"\n",
      "\"HORATIO\"\n",
      "\"Tush, tush, 'twill not appear.\"\n",
      "\"\"\n",
      "\"BARNARDO  Sit down awhile,\"\n",
      "\"And let us once again assail your ears,\"\n",
      "\"That are so fortified against our story,\"\n",
      "\"What we have two nights seen.\"\n",
      "\"\"\n",
      "\"HORATIO  Well, sit we down,\"\n",
      "\"And let us hear Barnardo speak of this.\"\n",
      "\"\"\n",
      "\"BARNARDO  Last night of all,\"\n",
      "\"When yond same star that's westward from the pole\"\n",
      "\"Had made his course t' illume that part of heaven\"\n",
      "\"Where now it burns, Marcellus and myself,\"\n",
      "\"The bell then beating one--\"\n",
      "\"\"\n",
      "\"[Enter Ghost.]\"\n",
      "\"\"\n",
      "\"\"\n",
      "\"MARCELLUS\"\n",
      "\"Peace, break thee off! Look where it comes again.\"\n",
      "\"\"\n",
      "\"BARNARDO\"\n",
      "\"In the same figure like the King that's dead.\"\n",
      "\"\"\n",
      "\"MARCELLUS, [to Horatio]\"\n",
      "\"Thou art a scholar. Speak to it, Horatio.\"\n",
      "\"\"\n",
      "\"BARNARDO\"\n",
      "\"Looks he not like the King? Mark it, Horatio.\"\n",
      "\"\"\n",
      "\"HORATIO\"\n",
      "\"Most like. It harrows me with fear and wonder.\"\n",
      "\"\"\n",
      "\"BARNARDO\"\n",
      "\"It would be spoke to.\"\n",
      "\"\"\n",
      "\"MARCELLUS  Speak to it, Horatio.\"\n",
      "\"\"\n",
      "\"HORATIO\"\n",
      "\"What art thou that usurp'st this time of night,\"\n",
      "\"Together with that fair and warlike form\"\n",
      "\"In which the majesty of buried Denmark\"\n",
      "\"Did sometimes march? By heaven, I charge thee,\"\n",
      "\"speak.\"\n",
      "\"\"\n",
      "\"MARCELLUS\"\n",
      "\"It is offended.\"\n",
      "\"\"\n",
      "\"BARNARDO  See, it stalks away.\"\n",
      "\"\"\n",
      "\"HORATIO\"\n",
      "\"Stay! speak! speak! I charge thee, speak!\"\n",
      "\"[Ghost exits.]\"\n",
      "\"\"\n",
      "\"MARCELLUS  'Tis gone and will not answer.\"\n",
      "\"\"\n",
      "\"BARNARDO\"\n",
      "\"How now, Horatio, you tremble and look pale.\"\n",
      "\"Is not this something more than fantasy?\"\n",
      "\"What think you on 't?\"\n",
      "\"\"\n",
      "\"HORATIO\"\n",
      "\"Before my God, I might not this believe\"\n",
      "\"Without the sensible and true avouch\"\n",
      "\"Of mine own eyes.\"\n",
      "\"\"\n",
      "\"MARCELLUS  Is it not like the King?\"\n",
      "\"\"\n",
      "\"HORATIO  As thou art to thyself.\"\n",
      "\"Such was the very armor he had on\"\n",
      "\"When he the ambitious Norway combated.\"\n",
      "\"So frowned he once when, in an angry parle,\"\n",
      "\"He smote the sledded Polacks on the ice.\"\n",
      "\"'Tis strange.\"\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "unparsed-text-lines(\"hamlet.txt\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "eb93ef7f",
   "metadata": {},
   "source": [
    "This ability to process sequences will be fundamental to scale out: here we are reading from your local drive,\n",
    "but JSONiq can also read from S3, Azure Blob Storage or HDFS, and it can handle sequences with billions of strings\n",
    "like a charm. It would not be realistic to return a single big string for a dataset with Terabytes of data: a huge sequence of small strings is then the way to go."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1cd650dd",
   "metadata": {},
   "source": [
    "# Try your own queries!\n",
    "\n",
    "This notebook is interactive. You can edit all queries above and also execute your own! We will show you more features every week."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "id": "fa53f4cf",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.013635873794555664 ms\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "1+1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "id": "c781a830",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.013123035430908203 ms\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "1+1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "id": "067e0db1",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.013500452041625977 ms\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "1+1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "id": "1ddcd5e7",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.012597322463989258 ms\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "1+1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "id": "e5b0ab65",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.012880086898803711 ms\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "1+1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "id": "987f06d0",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Took: 0.012665987014770508 ms\n",
      "2\n"
     ]
    }
   ],
   "source": [
    "%%jsoniq\n",
    "1+1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "7831547c",
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "ac36ecd5",
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "bdb50a93",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}