From 5e5e08b2d530b8e6ad6792b565a3e1d13a3458ec Mon Sep 17 00:00:00 2001 From: Chris Abraham Date: Wed, 10 Jul 2024 10:44:26 +0700 Subject: [PATCH 1/2] Added blog post "Learn how to develop Android applications with ExecuTorch and Llama models" Signed-off-by: Chris Abraham --- ...2024-07-09-develop-android-applications.md | 38 +++++++++++++++++++ 1 file changed, 38 insertions(+) create mode 100644 _posts/2024-07-09-develop-android-applications.md diff --git a/_posts/2024-07-09-develop-android-applications.md b/_posts/2024-07-09-develop-android-applications.md new file mode 100644 index 000000000000..3575429ce3be --- /dev/null +++ b/_posts/2024-07-09-develop-android-applications.md @@ -0,0 +1,38 @@ +--- +layout: blog_detail +title: "Learn how to develop Android applications with ExecuTorch and Llama models" +--- +Arm’s compute platform is delivering GenAI applications on phones, laptops, and servers. Cost, privacy, performance, security, and energy efficiency are just some of the reasons developers are investigating on-device AI. + +A new Learning Path explaining how to leverage the capabilities of large language models (LLMs) on Android using ExecuTorch and XNNPACK is now available. + +Here's a summary of what you'll learn: + +* Development Environment setup + + The Learning Path begins by guiding you through setting up your development environment, ensuring you have all the necessary tools installed, including Android Studio, the Android NDK, Java JDK, and Python. + +* ExecuTorch and XNNPACK + + You'll learn about the core technologies: ExecuTorch, a framework for deploying PyTorch models to edge devices, and XNNPACK, a high-performance library for executing neural networks on Arm-based platforms. + +* Llama models + + The Learning Path explores Llama, a family of powerful LLMs, focusing specifically on the 8B Llama 3 model. You'll learn about quantization techniques, which are essential for optimizing model size and performance on mobile devices. + +* Prepare Llama models for ExecuTorch + + You'll be guided through the process of downloading, exporting, and evaluating Llama models, ensuring they are ready for deployment using ExecuTorch. + +* Check model performance on Android + + The Learning Path walks you through cross-compiling the Llama runner binary for Android, allowing you to test your model's performance on your phone. + +* Build and run an Android Chat App + + Finally, you'll learn how to build a native Android chat app using the `LlamaDemo` application from the ExecuTorch repository. This hands-on experience allows you to put your knowledge into practice and create a real-world application. + + +Explore this Learning Path if you want to learn how to leverage the power of LLMs on your Android phone, and gain expertise in tools for on-device machine learning. + +Dig into the excitement of building Android chat apps and understand more about how they work. From 142f9640740b8f29261af2d2bb2be948560da1b0 Mon Sep 17 00:00:00 2001 From: Kylie Wagar-Dirks <107439830+kyliewd@users.noreply.github.com> Date: Wed, 10 Jul 2024 10:49:03 -0700 Subject: [PATCH 2/2] Update and rename 2024-07-09-develop-android-applications.md to 2024-07-10-develop-android-applications.md Signed-off-by: Kylie Wagar-Dirks <107439830+kyliewd@users.noreply.github.com> --- ...ications.md => 2024-07-10-develop-android-applications.md} | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) rename _posts/{2024-07-09-develop-android-applications.md => 2024-07-10-develop-android-applications.md} (78%) diff --git a/_posts/2024-07-09-develop-android-applications.md b/_posts/2024-07-10-develop-android-applications.md similarity index 78% rename from _posts/2024-07-09-develop-android-applications.md rename to _posts/2024-07-10-develop-android-applications.md index 3575429ce3be..6c6d91bba338 100644 --- a/_posts/2024-07-09-develop-android-applications.md +++ b/_posts/2024-07-10-develop-android-applications.md @@ -2,6 +2,8 @@ layout: blog_detail title: "Learn how to develop Android applications with ExecuTorch and Llama models" --- +_This blog is courtesy of the PyTorch team at Arm. More details can be found [here]([url](https://learn.arm.com/learning-paths/smartphones-and-mobile/build-llama3-chat-android-app-using-executorch-and-xnnpack/?utm_source=twitter&utm_medium=social-organic&utm_content=landingpage&utm_campaign=mk24_developer_na))._ + Arm’s compute platform is delivering GenAI applications on phones, laptops, and servers. Cost, privacy, performance, security, and energy efficiency are just some of the reasons developers are investigating on-device AI. A new Learning Path explaining how to leverage the capabilities of large language models (LLMs) on Android using ExecuTorch and XNNPACK is now available. @@ -35,4 +37,4 @@ Here's a summary of what you'll learn: Explore this Learning Path if you want to learn how to leverage the power of LLMs on your Android phone, and gain expertise in tools for on-device machine learning. -Dig into the excitement of building Android chat apps and understand more about how they work. +Dig into the excitement of building Android chat apps and understand more about how they work on the [Arm Developer Hub]([url](https://learn.arm.com/learning-paths/smartphones-and-mobile/build-llama3-chat-android-app-using-executorch-and-xnnpack/?utm_source=twitter&utm_medium=social-organic&utm_content=landingpage&utm_campaign=mk24_developer_na)).