LLMs beyond chat
From Conversations to Real-World Automation
Presenter:
Ovidijus Parsiunas
Presenter02 / 17
▍Presenter / 発表者
About me
Ovidijus Parsiunas
https://github.com/OvidijusParsiunas
www.linkedin.com/in/ovidijus-parsiunas-1a8a85106
Agenda02 / 16
▍Today / 今日
What we'll cover today
LLMs as tools
メンタルモデル ― チャット画面の向こうで、APIが実際に渡してくれるもの。
The agentic loop
関数呼び出し・フィードバック・反復が、モデルを「動く存在」に変える仕組み。
Examples
実例集 ― スマートホームから、ポケモンをプレイするLLMまで。
Automate your world
実践のコツ、落とし穴、そしてこの先の展望。
Chapter 01 · Foundations03 / 16
▍基本のチャット
Large Language Model
Chat
How are you doing?
I'm doing great, thanks for asking!
Input
Input
Response
LLM
Chapter 01 · Foundations04 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast
getStockPrice
Response
getForecastgetStockPrice+ Tokyo+ Tesla
<code/>
History +
19°C and partly cloudy
$370
Response
LLM
Chapter 01 · Foundations05 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast
getStockPrice
Response
getForecastgetStockPrice+ Tokyo+ Tesla
<code/>
History +
19°C and partly cloudy
$370
Response
LLM
Server
MCP Server
$370
Chapter 01 · Foundations06 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the light
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.Done
Input
Prompt
+
getForecasttoggleLight
getStockPricetoggleHeater
Response
Response
toggleLight+ ON
LLM
Chapter 01 · Foundations07 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the lightControl temperature
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.Done
Input
Prompt
+
getForecasttoggleLight
getStockPricetoggleHeatergetTemperature
Response
getTemperature
10°C
Response
toggleLight+ ON
toggleHeater+ ON
20°C
toggleHeater
+ OFF
LLM
Chapter 01 · Foundations08 / 17
▍エージェントループ
Agentic Loop
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the lightControl temperatureApproaching enemy
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.Done
Input
PromptPrompt / State
+
getForecasttoggleLightmove
getStockPricetoggleHeatergetTemperatureattack
Input
Response
getTemperature
attack
output
10°C
History +
Prompt / State
+
move
attack
10HP
Input
Response
toggleLight+ ON
toggleHeater+ ON
attack
output
20°C
History +
Prompt / State
+
move
attack
0HP
Input
toggleHeater+ OFF
move
output
LLM
Chapter 01 · Foundations09 / 17
▍エージェントループ
Agentic Loop
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?Turn on the lightControl temperatureApproaching enemyDrive a carLaunch a rocket to the moon
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.DoneSuccessfully landed
Input
PromptPrompt / State
+
getForecasttoggleLightmove
getStockPricetoggleHeatergetTemperatureattack
Input
Car is stationary
All systems OK
Response
getTemperature
attack
output
accelerate
mainEngineStart
10°C
10HP
Input
Green light
Approaching moon
Response
toggleLight+ ON
toggleHeater+ ON
attack
output
accelerate
deployLander
20°C
0HP
Input
Nearing red light
Altitude 50km
toggleHeater+ ON
move
output
stop
stageSeparation
LLM
Chapter 05 · Practice13 / 16
▍知っておくべき4つのこと
Four things worth knowing.
01 · Scope
Many calls > one long chat.
長い会話を続けるより、毎回新しい呼び出しを。
02 · Right-size
Simple models for simple tasks.
簡単なタスクには小さなモデルで十分。安くて速い。
03 · Mistakes
AI can make mistakes.
出力を信頼しすぎず、必ず検証する。
04 · Failure
APIs go down. Plan for it.
APIは落ちることがある。リトライやフォールバックを忘れずに。
Chapter 06 · Forward14 / 16
▍次に来るもの
What's coming next.
{ } · New idea
Programmatic tools
モデルが必要なツールをその場でコードとして生成する。
⇄ · Transport
WebSockets
双方向ストリームでリクエスト/レスポンスを置き換え、低遅延を実現。
↑ · Trajectory
Smarter · Faster · Cheaper
モデルは賢く、速く、安くなり続ける。
⌂ · Closer
Edge computing
デバイス上で動く小さなモデル。サーバーへの往復が不要に。
Chapter 01 · Foundations05 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast
getStockPrice
Response
getForecastgetStockPrice+ Tokyo+ Tesla
<code/>
History +
19°C and partly cloudy
$370
Response
LLM
Server
MCP Server
$370
Chapter 06 · Forward14 / 16
▍次に来るもの
What's coming next.
{ } · New idea
Programmatic tools
モデルが必要なツールをその場でコードとして生成する。
⇄ · Transport
WebSockets
双方向ストリームでリクエスト/レスポンスを置き換え、低遅延を実現。
↑ · Trajectory
Smarter · Faster · Cheaper
モデルは賢く、速く、安くなり続ける。
⌂ · Closer
Edge computing
デバイス上で動く小さなモデル。サーバーへの往復が不要に。
Chapter 01 · Foundations05 / 17
▍基本のチャット
Tools
Chat
How are you doing?What is the weather in Tokyo?What is the stock price of Tesla?
I'm doing great, thanks for asking!Tokyo is currently around 19°C and partly cloudyIt's trading around the mid-$370 range today.
Input
Prompt
+
getForecast
getStockPrice
Response
getForecastgetStockPrice+ Tokyo+ Tesla
History +
19°C and partly cloudy
$370
Response
LLM
Server
MCP Server
$370
Chapter 06 · Forward14 / 16
▍次に来るもの
What's coming next.
{ } · New idea
Programmatic tools
モデルが必要なツールをその場でコードとして生成する。
⇄ · Transport
WebSockets
双方向ストリームでリクエスト/レスポンスを置き換え、低遅延を実現。
↑ · Trajectory
Smarter · Faster · Cheaper
モデルは賢く、速く、安くなり続ける。
⌂ · Closer
Edge computing
デバイス上で動く小さなモデル。サーバーへの往復が不要に。
Q & A · 質問
▍ご質問をお待ちしております
Questions?
Fin · 終わり
▍ご清聴ありがとうございました