Skip to content

Commit ed71de7

Browse files
authored
Merge pull request #1076 from Jam3/Introducing-the-PlayTorch-app-blog-post
Introducing the play torch app blog post
2 parents 893b1d0 + ecaef4e commit ed71de7

9 files changed

+96
-0
lines changed
Lines changed: 96 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,96 @@
1+
---
2+
layout: blog_detail
3+
title: "Introducing the PlayTorch app: Rapidly Create Mobile AI Experiences"
4+
author: PlayTorch Team
5+
featured-img: ""
6+
---
7+
8+
<p align="center">
9+
<video width="100%" controls>
10+
<source src="/assets/videos/PlayTorch-video.mp4" type="video/mp4">
11+
</video>
12+
</p>
13+
14+
In December, we announced PyTorch Live, a toolkit for building AI-powered mobile prototypes in minutes. The initial release included a command-line interface to set up a development environment and an SDK for building AI-powered experiences in React Native. Today, we're excited to share that PyTorch Live will now be known as PlayTorch. This new release provides an improved and simplified developer experience. PlayTorch development is independent from the PyTorch project and the PlayTorch code repository is moving into the Meta Research GitHub organization.
15+
16+
## A New Workflow: The PlayTorch App
17+
18+
The PlayTorch team is excited to announce that we have partnered with [Expo](https://expo.dev) to change the way AI powered mobile experiences are built. Our new release simplifies the process of building mobile AI experiences by eliminating the need for a complicated development environment. You will now be able to build cross platform AI powered prototypes from the very browser you are using to read this blog.
19+
20+
In order to make this happen, we are releasing the [PlayTorch app](https://playtorch.dev/) which is able to run AI-powered experiences built in the [Expo Snack](https://snack.expo.dev/@playtorch/playtorch-starter?supportedPlatforms=my-device) web based code editor.
21+
22+
<p align="center">
23+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-1.gif" width="100%">
24+
</p>
25+
26+
The PlayTorch app can be downloaded from the Apple App Store and Google Play Store. With the app installed, you can head over to [playtorch.dev/snack](https://playtorch.dev/snack) and write the code for your AI-powered PlayTorch Snack. When you want to try what you’ve built, you can use the PlayTorch app’s QR code scanner to scan the QR code on the Snack page and load the code to your device.
27+
28+
NOTE: PlayTorch Snacks will not work in the Expo Go app.
29+
30+
## More to Explore in the PlayTorch App
31+
32+
### AI Demos
33+
34+
The PlayTorch app comes with several examples of how you can build AI powered experiences with a variety of different machine learning models from object detection to natural language processing. See what can be built with the PlayTorch SDK and be inspired to make something of your own as you play with the examples.
35+
36+
<p align="center">
37+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-2.jpg" width="100%">
38+
</p>
39+
40+
### Sharing Your Creations
41+
42+
Any PlayTorch Snack that you run in the PlayTorch app can be shared with others in an instant. When they open the link on their device, the PlayTorch app will instantly load what you’ve built from the cloud so they can experience it first hand.
43+
44+
<p align="center">
45+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-3.jpg" width="100%">
46+
</p>
47+
48+
When you have something you want to share, let us know on [Discord](https://discord.gg/sQkXTqEt33) or [Twitter](https://twitter.com/PlayTorch) or embed the PlayTorch Snack on your own webpage.
49+
50+
## SDK Overhaul
51+
52+
We learned a lot from the community after our initial launch in December and have been hard at work over the past several months to make the PlayTorch SDK (formerly known as PyTorch Live) simple, performant, and robust. In our initial version, the SDK relied on config files to define how a model ingested and output data.
53+
54+
Today, we are happy to announce the next version of our SDK can handle data processing in JavaScript for your prototypes with the new PlayTorch API that leverages the JavaScript Interface (JSI) to directly call C++ code. Not only have we completely redone the way you can interact with models, but we have also greatly expanded the variety of supported model architectures.
55+
56+
## A New Data Processing API for Prototyping
57+
58+
With this JSI API, we now allow users direct access to tensors (data format for machine learning). Instead of only having access to predefined transformations, you can now manipulate tensors however you would like for your prototypes.
59+
60+
<p align="center">
61+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-4.gif" width="100%">
62+
</p>
63+
64+
No more switching back and forth between code and config. You will now be able to write everything in JavaScript and have access to all of the type annotations and autocomplete features available to you in those languages.
65+
66+
Check out our [tutorials](https://playtorch.dev/tutorials) to see the new Data Processing API in action, take a deeper dive in the [API docs](https://playtorch.dev/docs/api/core/), or inspect the code yourself on [GitHub](https://github.com/facebookresearch/playtorch).
67+
68+
### Expanded Use Cases
69+
70+
With the new version of the SDK, we have added support for several cutting edge models.
71+
72+
<p align="center">
73+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-5.jpg" width="100%">
74+
</p>
75+
76+
Image-to-image transformations are now supported thanks to our robust JSI API, so you can see what your world would look like if it were an anime.
77+
78+
<p align="center">
79+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-6.jpg" width="100%">
80+
</p>
81+
82+
Translate French to English with an AI powered translator using the Seq2Seq model.
83+
84+
<p align="center">
85+
<img src="/assets/images/2022-7-15-introducing-the-playtorch-app-7.jpg" width="100%">
86+
</p>
87+
88+
Use DeepLab V3 to segment images!
89+
90+
## Start Playing
91+
92+
If you want to start creating AI experiences yourself, head over to [playtorch.dev](https://playtorch.dev) and try out our [tutorials](https://playtorch.dev/tutorials/). Each tutorial will guide you through building a simple AI powered experience that you can instantly run on your phone and share with others.
93+
94+
## How to Get Support
95+
96+
Join us on [Discord](https://discord.gg/sQkXTqEt33), collaborate with us on [GitHub](https://github.com/facebookresearch/playtorch), or follow us on [Twitter](https://twitter.com/playtorch). Got questions or feedback? We’d love to hear from you!
Loading
Loading
Loading
Loading
Loading
Loading
Loading

assets/videos/PlayTorch-video.mp4

18.1 MB
Binary file not shown.

0 commit comments

Comments
 (0)