SlideShare una empresa de Scribd logo
1 de 13
Descargar para leer sin conexión
人間VSロボット?!
ラッパーロボShimonの論文を読んでみた!
発表者:中村真裕
まずはじめにこちらを…
https://youtu.be/zPvVpG-aCNg
0:35-1:18に注目!
2
• Shimonというロボットを改良
したもの
• 元はマリンバを演奏するもの
だったが歌へも拡張された
• 今回の研究ではラッパーから
言われたことに対しグルーヴ
感を持って返しができるよう
にした
3
これは何?
• また、ラップの内容に合わ
せ眉と口が動く
• 右は”RAPPER”に対する口元
の様子
• でも何のために…?
4
これは何?
人間とロボットでラップバトル!
現状の実力を測るポイントは以下の3つ
• 人間VSロボットというアイデアをどう思うか?
• 被験者にシモンが実際にフリースタイルで勝負しているビデオクリップ45秒分を
見せコンセプトを紹介、フィードバックを使って感情分析
• ロボットのヒップホップのクオリティはどうか?
• シモンがラップしてる字幕付きの映像10本をランダムな順で被験者に見てもらう
• ヒップホップとメタルのデータセットからそれぞれサンプルを作成
• 一貫性、リズム、韻、クオリティ、面白さをそれぞれ1から7で評価
• インプットとアウトプットの関係はどうか?
• 見ず知らずのキーワードを基にした内容とそうでない内容それぞれに対しアンサ
ーを生成、前者より後者がいいと答えた数をスコアとして分析
6
• 回答内容に含まれる感情を分析すると
ネガティブ、ポジティブ、ニュートラル
、および複合的な感情の値が出てきた。
(複合感情は、-1.0(負)から1.0(正)
の間の正規化された加重複合スコア)
• 複合感情の平均は0.33であり、システム
の全体的な評価は悪くない。
• 全体的に予想よりも優れていると評価が
あった一方歌詞より声を重視していた。
• 右は感情評価と頻出ワードを示したもの
7
人間VSロボットというアイデアをどう思うか?
• どの項目でもヒップホップはメタルより
好評だった。
• リズムと面白さに相関性がなかった。
• クオリティと一貫性、リズム、そして韻
は切っても切り離せない。
• 肝心なのは面白さと他の評価軸との間で
ハッキリとした関係性を見出せなかった
こと。
• 右は各項目での評判と相関関係を示した 8
ロボットのヒップホップのクオリティはどうか?
• 被験者には質問10個を投げかける。
見ず知らずのキーワードを基にした
内容に対するアンサーよりもそうで
ない内容に対するアンサーが好きと
回答した数をスコアとし定義
• 例:7点なら7回既にある言葉の内容で
できたアンサーの方がいいと回答
• スコアに対し片側1のサンプルの
t検定を実行 9
インプットとアウトプットの関係はどうか?
• 平均スコアは6.2点/10点。
• p値は0.00033でアルファで
ある0.05より小さかった。
• つまり見ず知らずの言葉が
入るとそうでない場合より
クオリティで追いつけない
ということ。
10
インプットとアウトプットの関係はどうか?
まとめと今後の展望
• まとめ
• システムそのものは概ね好評
• 面白さの評価は他の項目とあまり関係なさそう
• 見ず知らずの言葉を入れられるとうまくいかない
• 今後の展望
• 見ず知らずの単語については文脈と発音の関係の研究が妥当という
のが著者らの仮説
• コンピュータービジョンを取り入れ眉や口以外もラップに合わせて
動けるようにするといいのではないか
11
書誌情報
• Title
Shimon the Rapper: A Real-Time System for Human-Robot
Interactive Rap Battles
• Authors
Richard Savery and Lisa Zahray and Gil Weinberg
• Belonging
Georgia Tech Center for Music Technology Atlanta, USA
• International Conference for Computational Creativity 2020, ICCC 20
• https://arxiv.org/pdf/2009.09234.pdf
12
発表者:中村真裕
AIZINE、DL輪読会、AI Quest等で活動中!
Twitter:中村真裕(@mshr_nkmr_ai)
今回の感想を #muana でコメントいただけ
ると幸いです
また繋がれる日を楽しみにしています!
13
ご静聴ありがとうございました!

Más contenido relacionado

Destacado

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

Destacado (20)

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 

(削除予定)人間VSロボット?!ラッパーロボShimonの論文を読んでみた!