lingo.lol is one of the many independent Mastodon servers you can use to participate in the fediverse.
A place for linguists, philologists, and other lovers of languages.

Server stats:

62
active users

#ise2023

0 posts0 participants0 posts today
Harald Sack<p>Last leg in our brief <a href="https://sigmoid.social/tags/timeline" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>timeline</span></a> of (Large) <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>languagemodels</span></a> (so far) is 2023, which saw the advent of many new and updated <a href="https://sigmoid.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLMs</span></a>:<br>- BARD <a href="https://sigmoid.social/tags/chatbot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>chatbot</span></a> is introduced by Google<br>- LLaMA is introduced by Meta <br>- GPT-4 is introduced by OpenAI.<br>- LLaMA2.0 is introduced by Meta <br>- and many others...<br><a href="https://sigmoid.social/tags/ISE2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ISE2023</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br>GPT-4 tech report: <a href="https://arxiv.org/pdf/2303.08774" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">arxiv.org/pdf/2303.08774</span><span class="invisible"></span></a> <br><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>KIT_Karlsruhe</span></a></span> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> <a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llms</span></a> <a href="https://sigmoid.social/tags/gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gpt</span></a> <a href="https://sigmoid.social/tags/openai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>openai</span></a> <a href="https://sigmoid.social/tags/llama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama</span></a> <a href="https://sigmoid.social/tags/lamda" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lamda</span></a> <a href="https://sigmoid.social/tags/bard" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bard</span></a></p>
Harald Sack<p>Next stop on our brief <a href="https://sigmoid.social/tags/timeline" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>timeline</span></a> of (Large) <a href="https://sigmoid.social/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LanguageModels</span></a> is 2022: <br>InstructGPT is introduced by OpenAI, a GPT-3 model complemented and fine-tuned with reinforcement learning from human feedback.<br>ChatGPT is introduced by OpenAI as a combination of GPT-3, Codex, and InstructGPT including lots of additional engineering.<br><a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br>RLHF explaned: <a href="https://huggingface.co/blog/rlhf" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">huggingface.co/blog/rlhf</span><span class="invisible"></span></a><br><a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/creativeai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>creativeai</span></a> <a href="https://sigmoid.social/tags/rlhf" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>rlhf</span></a> <a href="https://sigmoid.social/tags/gpt3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gpt3</span></a> <a href="https://sigmoid.social/tags/gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gpt</span></a> <a href="https://sigmoid.social/tags/openai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>openai</span></a> <a href="https://sigmoid.social/tags/chatgpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>chatgpt</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a></p>
Harald Sack<p>Next stop in our brief <a href="https://sigmoid.social/tags/timeline" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>timeline</span></a> of (large) <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>languagemodels</span></a> is 2021: <br>DALL-E is released by OpenAI and raises text2img to a new level.<br>Codex is released by OpenAI able to translate natural language into programming code.<br>WebGPT is released by OpenAI for answering open-ended questions.<br>LaMDA is introduced by Google.<br>Slides from <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a>: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br>Codex paper: <a href="https://arxiv.org/abs/2107.03374" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">arxiv.org/abs/2107.03374</span><span class="invisible"></span></a><br>DALL-E paper: <a href="https://arxiv.org/abs/2102.12092" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">arxiv.org/abs/2102.12092</span><span class="invisible"></span></a><br><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/generativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>generativeAI</span></a> <a href="https://sigmoid.social/tags/GPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GPT</span></a> <a href="https://sigmoid.social/tags/dalle" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dalle</span></a> <a href="https://sigmoid.social/tags/openai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>openai</span></a><br><a href="https://sigmoid.social/tags/lamda" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lamda</span></a></p>
Harald Sack<p>Next leg in our brief history of (Large) <a href="https://sigmoid.social/tags/LanguageModel" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LanguageModel</span></a> is 2020, when <a href="https://sigmoid.social/tags/GPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GPT</span></a>-3 was released by OpenAI, based on 45TB data crawled from the web. A “data quality” predictor was trained to boil down the training data to 550GB “high quality” data. Learning from the prompt was introduced (few-shot learning)<br>Lecture slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br>paper: <a href="https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">proceedings.neurips.cc/paper/2</span><span class="invisible">020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf</span></a><br><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <a href="https://sigmoid.social/tags/creativeai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>creativeai</span></a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a></p>
Harald Sack<p>Next stop in our brief Timeline of (large) <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>languagemodels</span></a> from the <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture is the advent of the Graphical Processing Units <a href="https://sigmoid.social/tags/gpu" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gpu</span></a>. In 1999 Nvidias GeForce 256 was one of the very first, which enabled highly parallel computations for <a href="https://sigmoid.social/tags/neuralnetworks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>neuralnetworks</span></a><br>Slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>machinelearning</span></a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a></p>
Harald Sack<p>1997 with the advent of Long Short-Term Memory recurrent <a href="https://sigmoid.social/tags/neuralnetworks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>neuralnetworks</span></a> marks the subsequent step in our brief history of )large) <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>languagemodels</span></a> from last week's <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture. Introduced by Sepp Hochreiter and Jürgen Schmidhuber <a href="https://sigmoid.social/tags/LSTM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LSTM</span></a> <a href="https://sigmoid.social/tags/RNNs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RNNs</span></a> enabled efficient processing of sequences of data. <br>Slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br><a href="https://sigmoid.social/tags/nlp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nlp</span></a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> <a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llms</span></a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span></p>
Harald Sack<p>Slide 2 of our Brief Timeline for (Large) <a href="https://sigmoid.social/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LanguageModels</span></a> from the last <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture introduced us to <a href="https://sigmoid.social/tags/ELIZA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ELIZA</span></a>, Joseph Weizenbaum's simple <a href="https://sigmoid.social/tags/Chatbot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Chatbot</span></a> from 1966 that simulates a conversation with a psychoanalyst. Weizenbaum was shocked that some persons including his secretary attributed human-like feelings to the computer program...<br>Slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br><a href="https://sigmoid.social/tags/nlp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nlp</span></a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span></p>
Harald Sack<p>As a 2nd topic of this last <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture, we were discussing <a href="https://sigmoid.social/tags/KnowledgeGraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>KnowledgeGraph</span></a> Completion. Most simple approach for unsupervised <a href="https://sigmoid.social/tags/linkprediction" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>linkprediction</span></a> based on (here translation-based) knowledge graph embeddings was explained on the example of Isaac Asimov. <br>Slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> <a href="https://sigmoid.social/tags/scifi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>scifi</span></a> <a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraphs</span></a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/deeplearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>deeplearning</span></a> <a href="https://sigmoid.social/tags/embeddings" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>embeddings</span></a></p>
Harald Sack<p>How can we find out the importance of a node in a <a href="https://sigmoid.social/tags/knowledgeGraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgeGraph</span></a>? In the last <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture, we were discussing graph centrality measures and how they can be applied in the context of knowledge graphs.<br>Slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br>SPARQL query (cf image below, the 100 most "important" <a href="https://sigmoid.social/tags/SciFi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SciFi</span></a> authors according to <a href="https://sigmoid.social/tags/wikidata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>wikidata</span></a>) <a href="https://w.wiki/78Un" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">w.wiki/78Un</span><span class="invisible"></span></a> <br><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> <a href="https://sigmoid.social/tags/semanticweb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>semanticweb</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/datascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>datascience</span></a> <a href="https://sigmoid.social/tags/analytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>analytics</span></a></p>
Harald Sack<p>Topics of the last <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture; The Graph in <a href="https://sigmoid.social/tags/KnowledgeGraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>KnowledgeGraphs</span></a>, Knowledge Graph Completion, A Brief History of Large Language Models, and Knowledge Graphs and Large Language Models. I will highlight some topics with the upcoming toots...<br>Slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1atNvM</span><span class="invisible">YNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</span></a><br><a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llms</span></a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>languagemodels</span></a> <a href="https://sigmoid.social/tags/deeplearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>deeplearning</span></a> <a href="https://sigmoid.social/tags/linkprediction" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>linkprediction</span></a> <a href="https://sigmoid.social/tags/kgc" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>kgc</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <a href="https://sigmoid.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>machinelearning</span></a> <a href="https://sigmoid.social/tags/transformers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>transformers</span></a> <a href="https://sigmoid.social/tags/gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gpt</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span></p>
Harald Sack<p>In last week's <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture we were discussing the Turing Test aka the Imitation Game as means to test a machine's ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human... However, in times of <a href="https://sigmoid.social/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ChatGPT</span></a> we have to rethink our concepts of "intelligence".<br>Slides: <a href="https://drive.google.com/file/d/1LUOA-NiE4nJ4sn5elbXUN4c7YDtK9uXB/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/1LUOA-</span><span class="invisible">NiE4nJ4sn5elbXUN4c7YDtK9uXB/view?usp=drive_link</span></a><br><a href="https://sigmoid.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>machinelearning</span></a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/turing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>turing</span></a> <a href="https://sigmoid.social/tags/turingtest" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>turingtest</span></a> <a href="https://sigmoid.social/tags/intelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>intelligence</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> <a href="https://sigmoid.social/tags/aiart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>aiart</span></a> <a href="https://sigmoid.social/tags/creativeai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>creativeai</span></a> <a href="https://sigmoid.social/tags/stablediffusionart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>stablediffusionart</span></a></p>
Harald Sack<p>“The only way to rectify our reasonings is to make them as tangible as those of the Mathematicians, so that we can find our error at a glance, and when there are disputes among persons, we can simply say: Let us calculate [calculemus], without further ado, to see who is right.”<br>Quoting Leibniz for last week's <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture with a brief <a href="https://sigmoid.social/tags/HistoryofAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HistoryofAI</span></a> <br>Slides: <a href="https://drive.google.com/file/d/18_xPnJDM04I7pDihMMhoFIuDshfUKMk9/view?usp=sharing" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/18_xPn</span><span class="invisible">JDM04I7pDihMMhoFIuDshfUKMk9/view?usp=sharing</span></a></p><p><a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artificialintelligence</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>KIT_Karlsruhe</span></a></span> @ebrahim <a href="https://sigmoid.social/tags/calculemus" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>calculemus</span></a> <a href="https://sigmoid.social/tags/logics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>logics</span></a> <a href="https://sigmoid.social/tags/leibniz" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>leibniz</span></a> <a href="https://sigmoid.social/tags/philosophy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>philosophy</span></a></p>
Harald Sack<p><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> ...and here is the notorious flying sheep sketch I alluded to in the <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture ;-)<br><a href="https://sigmoid.social/tags/flyingsheep" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>flyingsheep</span></a> <a href="https://sigmoid.social/tags/montypython" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>montypython</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <br><a href="https://youtu.be/9TeiSsJ3G_0" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">youtu.be/9TeiSsJ3G_0</span><span class="invisible"></span></a></p>
Harald Sack<p>The Open World Assumption is an important paradigm of the <a href="https://sigmoid.social/tags/SemanticWeb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SemanticWeb</span></a>. In our <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture we illustrate the <a href="https://sigmoid.social/tags/OWA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OWA</span></a> with the help of sheep...in allusion to a famous <a href="https://sigmoid.social/tags/MontyPython" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MontyPython</span></a> sketch...Can sheep fly?<br>Slides: <a href="https://drive.google.com/file/d/16nmZlsXVnYfQnC80x5mAiqIYLcztur_a/view?usp=sharing" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/16nmZl</span><span class="invisible">sXVnYfQnC80x5mAiqIYLcztur_a/view?usp=sharing</span></a><br><a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraphs</span></a> <a href="https://sigmoid.social/tags/descriptionlogics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>descriptionlogics</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> <br>P.S. Of course none of the students did know the sketch... <a href="https://sigmoid.social/tags/culturalheritage" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>culturalheritage</span></a> <a href="https://sigmoid.social/tags/ignorance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ignorance</span></a></p>
Harald Sack<p>Today in the <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture you will learn how to unleash the power of OWL, the Web Ontology language, as well as how to implement quality assurance for <a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraphs</span></a> with SHACL</p><p>Slides: <a href="https://drive.google.com/file/d/16nmZlsXVnYfQnC80x5mAiqIYLcztur_a/view?usp=sharing" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/16nmZl</span><span class="invisible">sXVnYfQnC80x5mAiqIYLcztur_a/view?usp=sharing</span></a></p><p><a href="https://sigmoid.social/tags/owl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>owl</span></a> <a href="https://sigmoid.social/tags/ontologies" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ontologies</span></a> <a href="https://sigmoid.social/tags/semanticweb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>semanticweb</span></a> <a href="https://sigmoid.social/tags/shacl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>shacl</span></a> <a href="https://sigmoid.social/tags/qualityassurance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>qualityassurance</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> <a href="https://sigmoid.social/tags/creativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>creativeAI</span></a> <a href="https://sigmoid.social/tags/stablediffusionart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>stablediffusionart</span></a> <a href="https://sigmoid.social/tags/aiart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>aiart</span></a> <a href="https://sigmoid.social/tags/mars" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>mars</span></a></p>
Harald Sack<p>How to write a SPARQL query? In this week's <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture we've provided you with a fundamental introduction into the SPARQL query language with tons of (working) examples.</p><p><a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraphs</span></a> <a href="https://sigmoid.social/tags/semanticweb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>semanticweb</span></a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <a href="https://sigmoid.social/tags/sparql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>sparql</span></a> <a href="https://sigmoid.social/tags/rdf" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>rdf</span></a> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span></p>
Harald Sack<p>At least thew have heard of Nineteen Eighty-Four and George Orwell... The small example <a href="https://sigmoid.social/tags/knowledgegraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraph</span></a> to explain how <a href="https://sigmoid.social/tags/SPARQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SPARQL</span></a> is working with iconic literary dystopias and scifi from our last <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture. This year's students have never heard of Asimov's Foundation...</p><p><a href="https://sigmoid.social/tags/scifi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>scifi</span></a> <a href="https://sigmoid.social/tags/foundation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>foundation</span></a> <a href="https://sigmoid.social/tags/semanticweb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>semanticweb</span></a> <a href="https://sigmoid.social/tags/culturalheritage" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>culturalheritage</span></a> <a href="https://sigmoid.social/tags/goodreads" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>goodreads</span></a></p>
Harald Sack<p>Tomorrow, we will have the next <a href="https://sigmoid.social/tags/ISE2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ISE2023</span></a> lecture. This time, you will learn about SPARQL and how to query RDF <a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraphs</span></a></p><p>Slides: <a href="https://drive.google.com/file/d/13gLES1BYGi9E__-tBsuWno6rPffFkR5G/view?usp=sharing" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">drive.google.com/file/d/13gLES</span><span class="invisible">1BYGi9E__-tBsuWno6rPffFkR5G/view?usp=sharing</span></a></p><p><a href="https://sigmoid.social/tags/SPARQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SPARQL</span></a> <a href="https://sigmoid.social/tags/RDF" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RDF</span></a> <a href="https://sigmoid.social/tags/SemanticWeb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SemanticWeb</span></a> <a href="https://sigmoid.social/tags/CreativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CreativeAI</span></a> <a href="https://sigmoid.social/tags/AIart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIart</span></a> <a href="https://sigmoid.social/tags/stablediffusionart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>stablediffusionart</span></a> <span class="h-card"><a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>enorouzi</span></a></span> <span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span></p>
Harald Sack<p>In the last <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ise2023</span></a> lecture, we've introduced <a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>knowledgegraphs</span></a> as an intuitive way to represent knowledge. But, graphs and labels alone are not sufficient... So, stay tuned for the next post on <a href="https://sigmoid.social/tags/ontologies" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ontologies</span></a> </p><p><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>KIT_Karlsruhe</span></a></span> <span class="h-card"><a href="https://nfdi.social/@nfdi4culture" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>nfdi4culture</span></a></span> <span class="h-card"><a href="https://troet.cafe/@nfdi4ds" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>nfdi4ds</span></a></span> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a></p>
Harald Sack<p>Last <a href="https://sigmoid.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NLP</span></a> chapter of our <a href="https://sigmoid.social/tags/ISE2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ISE2023</span></a> lecture last week was on distributional semantics and word embeddings. Of course, Wittgenstein had to be mentioned...</p><p><a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lecture</span></a> <a href="https://sigmoid.social/tags/distributionalsemantics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>distributionalsemantics</span></a> <a href="https://sigmoid.social/tags/wittgenstein" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>wittgenstein</span></a> <a href="https://sigmoid.social/tags/stablediffusionart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>stablediffusionart</span></a> <a href="https://sigmoid.social/tags/creativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>creativeAI</span></a> </p><p><span class="h-card"><a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>fizise</span></a></span> <span class="h-card"><a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>KIT_Karlsruhe</span></a></span></p>