Skip to main content

GitHub Copilot Workshop with Serko in Auckland

2 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

It was an incredible GitHub Copilot Hackathon with the amazing developers from Serko in Auckland! The passion and energy in the room were off the charts as we dove headfirst into exploring the potential of GitHub Copilot! 馃殌 From supercharging our coding workflows to discovering how AI can elevate our development game, this hackathon truly showcased the future of dev innovation.

GitHub Copilot, Microsoft's AI-powered coding assistant, was the star of the day, sparking excitement as developers explored its potential. From optimizing complex code structures to generating intelligent suggestions, Copilot proved to be a game-changer for boosting productivity and creativity in development.

alt text

alt text

alt text

The atmosphere was electric with collaboration and creativity as teams worked together to push the limits of what AI can do for coding. Participants came with unique perspectives, and it was amazing to see how their diverse backgrounds fueled some truly innovative ideas. Whether we were optimizing workflows or discussing new ways to streamline repetitive coding tasks, the energy in the room showed just how much potential AI has in transforming the way we develop software.

As we look ahead, it's clear that today was just the beginning. The potential of GitHub Copilot and AI-driven tools in development is immense, and we're only scratching the surface. From increased productivity to smarter, more efficient coding solutions, the future of development has never looked more exciting!

alt text

alt text

alt text

alt text

Read more via LinkedIn Post

Azure AI App in a Day at Microsoft Brisbane Again

One min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

We are back at Microsoft Brisbane office again for our second Azure AI App in a Day workshop.

Ready to build the next million-dollar app in just a day? 馃挕 We've just completed our second AzureAIAppInADay in Brisbane Microsoft office. Rakesh Lakshminarayana and I had so much fun leading the workshop, and we're glad to see more participants make it to the end - some of you without even a dev background! It's been amazing to keep the momentum going. A big thank you to Tricia Read and Ross Johnson.

In this workshop, we got hands-on with AI app development, RAG (Retrieval-Augmented Generation), prompt engineering and built a chatbot using CosmosDb for MongoDb. With the power of Azure and OpenAI, we're helping organizations bring their AI ideas to life!

Excited to see what incredible apps come next! Our Insight team is around to help.

alt text

alt text

alt text

alt text

Read more via LinkedIn Post

Azure AI App in a Day at Microsoft Brisbane

3 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

I recently presented and co-hosted an Azure AI App in a Day workshop in Microsoft's Brisbane office, surrounded by 40+ developers who were just as excited as I am about learning AI and building innovative apps. It was an action-packed day, full of coding and collaboration, where we explored the possibilities of using AI in real-world applications. We dove deep into various Azure AI services, learning how to integrate machine learning models, natural language processing, and more into app innovations.

The workshop was not just about learning theory, we spent most of the time writing code together, which made it both engaging and practical. Everyone was there to push their limits and see how they could apply AI to solve real-world problems. There was a real sense of community and shared passion, which made the learning experience even more enjoyable.

During the session, I had the chance to share our own LEGO AI app with the group. This app, which we've built using several Azure AI services, helps students by providing them with AI-generated coding solutions for SPIKE Prime robots. It was great to show how AI can be used in education and robotics, two fields that are close to my passion. The feedback I received was incredibly positive. People were excited about how AI could be used in such practical, hands-on ways to empower the next generation of students and engineers.

alt text

alt text

alt text

alt text

Sharing the LEGO AI app also sparked some meaningful discussions. We talked about how AI can be integrated into everyday life, not just in high-tech or corporate environments, but in educational settings where students are learning to code, solve problems, and think critically. Developers were intrigued by the idea of using AI not only to build complex systems but also to inspire young minds. It was a reminder that AI has the potential to impact more than just technology - it can inspire creativity and learning in new ways.

One of the biggest takeaways from the workshop was the idea that the best AI app ideas often come from your passions. Whether it's education, robotics, or something completely different, finding an area you care about can lead to the most impactful and rewarding projects. When you're passionate about a subject, you naturally want to find better ways to improve or innovate, and that's where AI can really shine.

As I left the workshop, I was energized by all the new ideas floating around the room. It was a great reminder that AI is not just about data and algorithms. It's about creativity, innovation, and making life better in ways big and small. So, when you're looking for your next AI app idea, look to the passions in your life. You never know how AI might help turn your interests into something truly innovative.

Read more via LinkedIn Post

Build Chatbot for Submerged Season for Documents

3 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

In this FLL season, we decided to take our chatbot project to the next level. On top of helping us with coding for the LEGO SPIKE Prime, we wanted to explore if we could add all the season documents into the chatbot to help with research and navigating through the rules of the robot game. The idea was to make it easier for our team to access and understand the challenge, rules, and guidelines, all in one place, through a simple conversation with the bot.

To do this, we downloaded all the essential documents: PDFs, excel spreadsheets, PowerPoints from the FIRST LEGO League website. These documents contain all essential information about the Submerged season, including robot game rules, mission details, and field setup instructions. We then uploaded everything to our Azure storage account, which made it easy to connect the documents with our chatbot.

alt text

Using Azure, we linked the chatbot with the documents so it could answer questions related to the robot game rules and season guidelines. For example, if we needed to know what specific missions required or how points were awarded, we could ask the chatbot, and it would pull the information directly from the official documents.

The setup process on Azure turned out to be more straightforward than we anticipated using Azure AI Studio. Azure provides great tools for building, training, and deploying AI models, and we were able to get our chatbot running smoothly in a short amount of time. It was a valuable learning experience to see how cloud-based AI services like Azure work in real life. With this setup, our chatbot became a research assistant, helping us quickly reference complex rules and documents during our robot strategy sessions.

We are also keen on responsible AI during our learning. This season, we had sessions with students on AI bias and responsible AI use, which were critical in shaping how we approached this project. We taught the students that while AI can be incredibly powerful, it's also important to recognize its limitations. It's not just about getting the right answer; it's about understanding how the AI processes information and ensuring it's providing accurate and unbiased responses.

alt text

We talked about how bias can creep into AI models, especially when the data or documents they rely on are incomplete or misinterpreted. By being cautious and ensuring we used the chatbot as a support tool rather than the sole decision-maker, we are ready to explore AI's potential responsibly.

We're excited to continue using our chatbot for coding, research, and game strategy while keeping in mind the lessons we've learned about using AI. Our team is ready to dive into the Submerged season with confidence, knowing we have the tools and understanding to make the most of AI without losing sight of what's most important: learning, teamwork, and innovation.

Build Chatbot for Submerged Season for Coding

3 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

In the new Submerged season of FIRST LEGO League (FLL), we are continuing our journey of using AI to help us learn, innovate, and make robotics more accessible to everyone. Our team took the initiative to build a chatbot using Microsoft Azure (with lots of helps from coaches) and publish an app that anyone can use, free of charge. This was a big step toward creating a more inclusive, cost-effective way for young engineers and coders to get the most out of AI.

One of the challenges we faced when using tools like ChatGPT is that they often require users to create an account, and there are costs associated with using advanced AI features. This creates a barrier for many students and teams who might not have access to these resources. To solve this, we built a free version of our chatbot that specifically focuses on the needs of FLL participants. We locked down the scope of the questions and answers so that they only relate to the official season documents and guides for the Submerged challenge, as well as coding instructions for the LEGO SPIKE Prime 3.

The chatbot is designed to be simple and focused, giving users clear, relevant information about the FLL challenge and the Python coding required for SPIKE Prime 3 robots. Whether a team needs help understanding the mission details or figuring out how to make their robot move in a specific way, our chatbot has the answers.

alt text

alt text

One of the key skills we emphasized this season is prompt engineering. The art of asking the right questions to get the best answers from an AI. While many people assume that AI automatically gives perfect responses, the truth is that how you ask a question can dramatically affect the quality of the answer you receive. We've been teaching our team and users of the chatbot how to frame their prompts clearly and concisely to get more accurate and useful information.

For example, instead of asking, "How do I code my robot?" a better prompt might be, "Write Python code to move my SPIKE Prime 3 robot forward for 5 seconds and stop." By being specific, users can get actionable responses that directly help with their projects.

This new chatbot, combined with prompt engineering techniques, empowers young engineers to not only rely on AI for quick solutions but also to better understand how to interact with technology in ways that enhance their learning experience. We're excited to see how teams use this tool during the Submerged season and how it helps them innovate and succeed. We hope to remove some of the barriers that traditionally come with using advanced AI tools and give every FLL team a chance to harness the power of AI for their robotic challenges.

FLL Submerged Season Kickoff Tech Talk

3 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

I had the exciting opportunity to present a talk at the FIRST LEGO League (FLL) Australia season kickoff in August 2024, an event where young minds gather to prepare for a year full of innovation, teamwork, and, of course, robotics. My talk was titled, "ChatGPT, Write Python Code for My Robot, Please!", A topic that connected artificial intelligence, robotics, and education in a way that resonated with both the kids and mentors.

One of the most exciting things to prepare for this talk was building up a Python knowledge base specifically for the LEGO SPIKE Prime, the popular robotics kit used in FLL. SPIKE Prime uses a powerful hub and motors that can be programmed in Python. By leveraging ChatGPT's advanced language model and training it with SPIKE Prime's API and specifications, I was able to get it to generate Python code that effectively controls the robot's movements and sensors. This is a great option for kids (and even adults) who might struggle with the initial complexities of writing code from scratch.

alt text

For example, using simple natural language prompts like "write Python code to move the robot forward for 20 cm", ChatGPT can now produce highly accurate, ready-to-run Python scripts that control the motors of a LEGO robot.

During the presentation, I walked the audience through several real-world examples of how ChatGPT can assist in generating Python code for SPIKE Prime robots. I showed how, with minimal guidance, the AI could create scripts that made the robot move forward, turn, stop, and even detect objects using sensors. The kids were thrilled to see how a few simple prompts resulted in real-time robot movement, and their imaginations lit up at the possibilities of using AI to enhance their learning and problem-solving.

One key aspect of my talk was addressing the responsible use of AI as a learning tool. I emphasized how tools like ChatGPT should not be seen as a shortcut or replacement for understanding core concepts but rather as a tool to enhance learning. I encouraged the kids to experiment with the AI, ask it questions, and use it to break down complex problems, but to also remain curious about how the code works. This way, they could continue learning and developing their own skills while benefiting from the AI's assistance.

To make the talk even more engaging, I introduced two major figures in the tech world: Satya Nadella, CEO of Microsoft, and Sam Altman, CEO of OpenAI. I explained their roles in the development of AI and how their vision has contributed to making these cutting-edge technologies more accessible to everyone. The kids were fascinated to learn about the real people behind the tools they were interacting with and how AI is evolving to shape the future of not just robotics, but many industries.

The talk was super fun! The combination of showing how AI can be a practical, hands-on tool for robotics, while also discussing the broader implications of responsible AI use, made it a well-rounded experience. Watching the kids' excitement as they saw the robots come to life through AI-generated code was a highlight, and I hope they left feeling empowered to continue exploring the amazing world of robotics and AI.

FLL Submerged Season Sneek Peak

2 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

The New FLL Submerged Season Is Just Around the Corner! 馃寠

As the FIRST LEGO League (FLL) Submerged season approaches, We are already thinking about how we can make the most of AI to tackle the challenges ahead. This season's theme revolves around underwater exploration, and I'm excited to see how we can take our robotics game to the next level using AI-driven tools.

alt text

My focus this time will be on improving two key areas:

  1. Enhancing the accuracy of Python code output for LEGO robots.
  2. Better understanding of users' commands to create more efficient coding solutions.

I'm thinking of using GPT to build a custom chatbot that can help with these tasks. Imagine having a chatbot that doesn't just understand generic Python code, but knows the ins and outs of LEGO robot programming! This would mean more accurate code suggestions tailored specifically to FLL robots and tasks, which is a game-changer for programming efficiency and strategy execution.

To make this happen, I've been working on some prompt engineering to improve how the AI interprets commands. I've also created a detailed LEGO Python API spec and description documents based on the official Spike Prime website. This will help the chatbot understand the unique functions and syntax needed to control the robot during FLL missions.

By customizing the AI's knowledge with these API docs, we can train it to generate highly accurate code snippets for movement, sensor interaction, and strategy planning. This could save a lot of time during robot development and testing, allowing us to focus on fine-tuning strategies rather than troubleshooting code.

The idea of combining AI and robotics for FLL is super exciting, and I can't wait to dive deeper into this project as the season progresses. Who knows, maybe AI will give us the edge we need to ace the Submerged season!

FLL Masterpiece APOC AI Innovation Project

2 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

Team Cleverbots embarked on an exciting journey this year, advancing through both regional and national competitions. Their dedication and hard work paid off when they were invited to participate in the prestigious international competition for the Masterpiece season. As part of their innovation project, I had the privilege of helping them develop a web app. The app, powered by an AI chatbot, is designed to inspire people to explore new hobbies through personalized recommendations, making it easier for users to discover activities they might not have otherwise considered.

As the coach of Team Cleverbots, I work closely with a group of seven enthusiastic Year 7 and 8 girls. Their drive and passion for technology are remarkable, and together they developed an innovative application called "Fresh - Hobby Sharing AI App." During the four-day international event, I supported the team by delivering presentations, demonstrating the app's unique features, and helping them engage with participants from across the globe. The event was a melting pot of creativity, featuring robot competitions and team-building exercises, with 52 teams representing 26 different countries. It was a fantastic opportunity for the girls to showcase their skills and creativity on a global stage.

This international event not only served as a platform to demonstrate the power of AI in innovation but also sparked meaningful conversations among coaches, educators, and participants. We discussed the implications of AI in education, how it can shape the future, and the importance of ensuring that young students are empowered to create with these technologies. The event highlighted how technology can be a tool for both personal growth and global collaboration, and I'm incredibly proud to have been part of such an inspiring experience with Team Cleverbots.

alt text

alt text

alt text

FLL Masterpiece APOC (International)

2 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

Hooray! We Are Invited to the FLL Asia Pacific Open Championship! 馃帀

I'm thrilled to share that Team Cleverbots was invited to the FIRST LEGO League (FLL) Asia Pacific Open Championship at Macquarie University! With 52 teams from 26 different countries, it's an incredible opportunity to compete, share knowledge, and, of course, have some serious fun with LEGO robots.

The event spans four amazing days, and it's been nothing short of spectacular. We've competed in intense challenges, presented our innovative projects, and celebrated every moment with singing, dancing, and chanting! The energy here is off the charts, and it's been such a joy to connect with teams from all over the world.

What makes this event even more special is the sense of community and collaboration. Teams from across the globe are not just competing, but sharing their strategies, learning from one another, and building friendships. It's a beautiful mix of cultures, technology, and creativity all coming together through the love of robotics.

Every minute of the championship has been a blast, from the thrilling competition rounds to the downtime where we bond over common interests and celebrate each other's achievements. Seeing people from so many countries come together over a shared passion for LEGO robots has been truly inspiring.

alt text

alt text

Whether it's working on our robot's strategy or cheering each other on during matches, this experience has been one for the books. Here's to the amazing memories, new friendships, and endless fun we've had at the FLL Asia Pacific Open Championship. We've enjoyed every second of it!

Azure OpenAI Hackathon Winner

2 min read
Daniel Fang
AI, Robotics & LEGO Enthusiast

Winner, Winner, Chicken Dinner! 馃帀

I just received an email from the DevPost team, and guess what? My project is a winner in the Microsoft Azure OpenAI Hackathon! I'm beyond excited to share that my AI app made it to the top 4 places. What started as a quick experiment has turned into something truly rewarding!

It's incredible to think that this AI app, which I put together in a short time (a few long nights on the weendes), stood out among so many great projects. The voice interaction, speech output, and language translation features seem to have really struck a chord with the judges. I couldn't be happier with the outcome!

alt text

Now that the adrenaline of the win is starting to settle, I'm thinking about what's next. Winning is fantastic, but the real value lies in how we can take this project further and apply it in meaningful ways. One big question that's been on my mind: How can we use these AI tools to engage young students in coding and learning?

AI-powered apps, like the one I built, have the potential to transform education in meaningful ways. Imagine:

  • AI tutors that help students understand coding concepts step-by-step, making complex topics more approachable.
  • Interactive coding lessons where students can communicate with the bot using voice commands, making it more fun and less intimidating.
  • Multilingual support to help non-native English speakers learn to code in their preferred language, breaking down barriers to entry.
  • Instant feedback where students can ask the chatbot for coding help and get immediate answers, encouraging exploration and problem-solving.

There's so much potential to use AI to make learning more engaging, accessible, and fun. I'm excited to explore how I can turn this hackathon project into a real tool for education that sparks curiosity and creativity in young minds.

Onward to the next challenge! 馃帀