LLMs beyond chat
From Conversations to Real-World Automation
Presenter:
Ovidijus Parsiunas
Presenter02 / 17
▍Presenter / 発表者
About me
Ovidijus Parsiunas
https://github.com/OvidijusParsiunas
www.linkedin.com/in/ovidijus-parsiunas-1a8a85106
Agenda02 / 16
▍Today / 今日
What we'll cover today
LLMs as tools
メンタルモデル ― チャット画面の向こうで、APIが実際に渡してくれるもの。
The agentic loop
関数呼び出し・フィードバック・反復が、モデルを「動く存在」に変える仕組み。
Examples
実例集 ― スマートホームから、ポケモンをプレイするLLMまで。
Automate your world
実践のコツ、落とし穴、そしてこの先の展望。
Chapter 01 · Foundations03 / 16
▍基本のチャット
Large Language Model
Chat
How are you doing?
I'm doing great, thanks for asking!
Input
Prompt
Response
LLM
Chapter 01 · Foundations04 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast()
getStockPrice()
Response
getForecast()getStockPrice()+ Tokyo+ Tesla
<code/>
19°C and partly cloudy
$370
Response
LLM
Chapter 01 · Foundations05 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast()
getStockPrice()
Response
getForecast()getStockPrice()+ Tokyo+ Tesla
<code/>
19°C and partly cloudy
$370
Response
LLM
Another API
MCP server
$370
Chapter 01 · Foundations06 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the light
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.Done
Input
Prompt
+
getForecast()toggleLight()
getStockPrice()toggleHeater()
Response
Response
toggleLight()+ ON
LLM
Chapter 01 · Foundations07 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the lightControl temperature
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.Done
Input
Prompt
+
getForecast()toggleLight()
getStockPrice()toggleHeater()getTemperature()
Response
getTemperature()
10°C
Response
toggleLight()+ ON
toggleHeater()+ ON
Fail
toggleHeater()
+ ON
LLM
Chapter 01 · Foundations08 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the lightControl temperatureNext move
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.Done
Input
PromptPrompt / Context
+
getForecast()toggleLight()move()
getStockPrice()toggleHeater()getTemperature()attack()
Input
Response
getTemperature()
attack()
output()
10°C
10HP
Input
Response
toggleLight()+ ON
toggleHeater()+ ON
attack()
output()
Fail
0HP
Input
toggleHeater()+ ON
move()
output()
LLM
Chapter 01 · Foundations09 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the lightControl temperatureNext moveDrive a carLaunch a rocket to the moon
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.DoneSuccessfully landed
Input
PromptPrompt / Context
+
getForecast()toggleLight()move()
getStockPrice()toggleHeater()getTemperature()attack()
Input
Car is stationary
All systems OK
Response
getTemperature()
attack()
output()
accelerate()
mainEngineStart()
10°C
10HP
Input
Green light
Approaching moon
Response
toggleLight()+ ON
toggleHeater()+ ON
attack()
output()
accelerate()
deployLander()
Fail
0HP
Input
Nearing red light
Altitude 50km
toggleHeater()+ ON
move()
output()
stop()
stageSeparation()
LLM
Chapter 05 · Practice13 / 16
▍知っておくべき4つのこと
Four things worth knowing.
01 · Scope
Many calls > one long chat.
長い会話を続けるより、毎回新しい呼び出しを。
02 · Right-size
Simple models for simple tasks.
簡単なタスクには小さなモデルで十分。安くて速い。
03 · Mistakes
AI can make mistakes.
出力を信頼しすぎず、必ず検証する。
04 · Failure
APIs go down. Plan for it.
APIは落ちることがある。リトライやフォールバックを忘れずに。
Chapter 06 · Forward14 / 16
▍次に来るもの
What's coming next.
{ } · New idea
Programmatic tools
モデルが必要なツールをその場でコードとして生成する。
⇄ · Transport
WebSockets
双方向ストリームでリクエスト/レスポンスを置き換え、低遅延を実現。
↑ · Trajectory
Smarter · Faster · Cheaper
モデルは賢く、速く、安くなり続ける。
⌂ · Closer
Edge computing
デバイス上で動く小さなモデル。サーバーへの往復が不要に。
Chapter 01 · Foundations05 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast()
getStockPrice()
Response
getForecast()getStockPrice()+ Tokyo+ Tesla
<code/>
19°C and partly cloudy
$370
Response
LLM
Another API
MCP server
$370
Chapter 06 · Forward14 / 16
▍次に来るもの
What's coming next.
{ } · New idea
Programmatic tools
モデルが必要なツールをその場でコードとして生成する。
⇄ · Transport
WebSockets
双方向ストリームでリクエスト/レスポンスを置き換え、低遅延を実現。
↑ · Trajectory
Smarter · Faster · Cheaper
モデルは賢く、速く、安くなり続ける。
⌂ · Closer
Edge computing
デバイス上で動く小さなモデル。サーバーへの往復が不要に。
Chapter 01 · Foundations05 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast()
getStockPrice()
Response
getForecast()getStockPrice()+ Tokyo+ Tesla
19°C and partly cloudy
$370
Response
LLM
Another API
MCP server
$370
Chapter 06 · Forward14 / 16
▍次に来るもの
What's coming next.
{ } · New idea
Programmatic tools
モデルが必要なツールをその場でコードとして生成する。
⇄ · Transport
WebSockets
双方向ストリームでリクエスト/レスポンスを置き換え、低遅延を実現。
↑ · Trajectory
Smarter · Faster · Cheaper
モデルは賢く、速く、安くなり続ける。
⌂ · Closer
Edge computing
デバイス上で動く小さなモデル。サーバーへの往復が不要に。
Q & A · 質問
▍ご質問をお待ちしております
Questions?
Fin · 終わり
▍ご清聴ありがとうございました