From Student to Cloud Builder: Starting My AI/ML Journey with AWS

Building a machine learning model is exciting, but making it accessible to the real world is where the real learning begins! 🚀 #AWS #CloudComputing #ArtificialIntelligence #MachineLearning #AWSCommunity #StudentDevelopers

Building a machine learning model is exciting, but making it accessible to the real world is where the real learning begins! 🚀 #AWS #CloudComputing #ArtificialIntelligence #MachineLearning #AWSCommunity #StudentDevelopers

☁️ Cloud AWS S3 Tables simplify lakehouse migrations to Apache Iceberg, while Google Cloud Spend Caps give engineering leaders automated real-time financial containment against unexpected API cost spikes.   🔒 Cybersecurity Traditional Secure Email Gateways miss over 41% of phishing attacks due to native AI domain spoofing and OAuth abuse, accelerating the urgency around emerging deployer liability models for autonomous agent breaches.   🤖 AI/ML OpenAI GPT-6 Cyber's automated vulnerability discovery highlights the rapidly shifting capabilities of frontier models, requiring enterprises to wrap autonomous AI agents with strict runtime isolation and identity boundaries.   Source:  https://www.linkedin.com/pulse/weekly-news-update-6112026-eyal-estrin--vsoyf/   #Cloud #Cybersecurity #AI

Groups Conversations All groups and messages Sign in     GCP ML Project: Explaining Loan Default Risk Predictions with Vertex AI, BigQuery and XGBoost 0 views Eyal Estrin unread, 10:08 AM (10 minutes ago)    to https://medium.com/google-cloud/gcp-ml-project-explaining-loan-default-risk-predictions-with-vertex-ai-bigquery-and-xgboost-1b074b683341 Eyal Estrin Author | Cloud Architect | AWS • Azure • GCP Insights Social: @eyalestrin Connect: https://linktr.ee/eyalestrin Blog: https://security-24-7.com Reply all Reply to author Forward

Storage-optimized Z4M machine series in Google Compute Engine are available as both Virtual Machine (VM) and bare-metal instances.

Groups Conversations All groups and messages Sign in Machine Learning, Deep Learning and AI Conversations About Privacy • Terms     Your ML Platform Isn’t Kubernetes-Native Just Because It Runs on Kubernetes 0 views Eyal Estrin unread, 4:34 AM (26 minutes ago)    to https://cloudnativenow.com/contributed-content/your-ml-platform-isnt-kubernetes-native-just-because-it-runs-on-kubernetes/ Eyal Estrin Author | Cloud Architect | AWS • Azure • GCP Insights Social: @eyalestrin Connect: https://linktr.ee/eyalestrin Blog: https://security-24-7.com Reply all Reply to author Forward

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and...

☁️ Cloud AWS S3 Tables simplify lakehouse migrations to Apache Iceberg, while Google Cloud Spend Caps give engineering leaders automated real-time financial containment against unexpected API cost spikes. 🔒 Cybersecurity Traditional Secure Email Gateways miss over 41% of phishing attacks due to native AI domain spoofing and OAuth abuse, accelerating the urgency around emerging deployer liability models for autonomous agent breaches. 🤖 AI/ML OpenAI GPT-6 Cyber's automated vulnerability discovery highlights the rapidly shifting capabilities of frontier models, requiring enterprises to wrap autonomous AI agents with strict runtime isolation and identity boundaries. Source: https://www.linkedin.com/pulse/weekly-news-update-6112026-eyal-estrin--vsoyf/ #Cloud #Cybersecurity #AI

A journey of continuous learning, practical development, and exploring emerging technologies. Sharing my experience as an MCA student, working on real-world projects, participating in SIH 2026, and exploring AWS, Cloud Computing, AI/ML, and Full-Stack Development. My goal is to keep learning, building, experimenting, and growing as a software engineer.

The cloud giant refits its agentic dev tools for agent orchestration

> **TL;DR —** On-device small language models solve the latency and privacy problems of cloud inference, but they trade them for a distribution problem: shipping, versioning, monitoring, and rolling back weights across a fleet of devices you can't SSH into. Most ML teams have no playbook for this because it isn't an ML problem — it's a release-engineering problem wearing an ML costume. Everyone building on-device AI right now is optimizing the wrong bottleneck. The industry obsession with quantization, distillation, and squeezing a model under some RAM ceiling makes it look like the hard part of edge AI is making a small language model small enough. It isn't. The hard part starts after the model fits. The hard part is what happens on day two, when you need to change it. A hosted LLM is a service. You patch the prompt, swap the weights, roll back a bad deployment, and every client sees the fix within minutes. An on-device small language model is not a service. It is a binary artifact sitting inside an app bundle or a firmware image, physically distributed across thousands or millions of devices you do not control and cannot reach on demand. That distinction — service versus artifact — is the whole story, and most ML teams are not organizationally built to handle the artifact side of it. ## You didn't ship a model. You shipped a release. When a small language model moves on-device, it inherits every constraint of mobile and embedded release engineering, whether your ML team knows those constraints exist or not. App store review cycles. OTA update windows that users can decline. Devices that stay on old firmware for years. Bandwidth-constrained delta updates where a full re-download of the weights is a user-hostile non-starter. Cloud ML teams get to treat deployment as a solved problem — push to the serving cluster, watch the dashboard, roll back the canary if latency spikes. Edge ML teams inherit a deployment problem that mobile engineers have spent two decades hardening against: staged rollouts, binary diffing, rollback that actually reaches users instead of just flipping a server flag. If your model-release process doesn't already answer "how fast can we undo this for 10% of the fleet," you don't have a release process — you have a hope. ## One model, many binaries The fleet heterogeneity problem compounds this. "The model" isn't one artifact, it's a matrix. The same small language model gets quantized differently for different NPUs, compiled against different accelerator SDK versions, and tuned for different memory tiers across a device lineup that spans several hardware generations. A fix validated on one quantization path can silently misbehave on another because the numerical error introduced by int4 versus int8 packing interacts differently with the model's sensitivity to specific layers. This means your eval suite isn't evaluating a model anymore — it's evaluating a combinatorial space of model-times-hardware-times-runtime combinations, most of which you cannot reproduce on a developer laptop. Teams that built their evaluation pipeline for a single hosted checkpoint find out, usually in production, that "passing eval" meant passing it on one build target out of a dozen that actually ship. ## The telemetry blackout Hosted inference gives you a feedback loop almost for free. Every request and response flows through your infrastructure, so you can log failures, cluster bad completions, and feed them back into the next fine-tuning run. On-device inference deliberately breaks that loop, because the entire point of running locally is often privacy: the user's prompts and the model's outputs never leave the device. This is the part that gets underestimated. You've solved a privacy problem and created a blindness problem in the same move. You cannot casually scrape failure cases from production the way a cloud team does. If a small language model starts hallucinating on a specific class of input after an OS update changes some floating-point behavior in the accelerator driver, you may never find out — there's no centralized log tying symptom to cause. The feedback loop that makes iterative model improvement possible in the cloud has to be deliberately and carefully rebuilt on-device, usually through opt-in, aggregated, differentially private telemetry, which is a serious engineering project in its own right, not a checkbox. ## Rollback is the feature you didn't build In cloud serving, rollback is almost trivial: repoint traffic to the previous checkpoint. On-device, rollback means pushing another binary update through the same slow, user-gated channel that got you into trouble in the first place. If the bad model shipped inside a major app version, your "rollback" might be a forced update that some fraction of your fleet never installs. If it shipped inside firmware, you might be looking at a multi-week remediation timeline during which the broken model keeps running on real devices doing real tasks. This changes the calculus for what counts as an acceptable launch. A cloud team can ship slightly-risky changes because the blast radius is minutes. An edge AI team shipping a small language model needs to treat every release the way firmware teams treat a bootloader change: assume you cannot fully undo it, and gate accordingly, with staged percentage rollouts, device-class segmentation, and kill switches that can disable a feature without requiring the user to update anything. ## What this actually demands None of this is an argument against small language models on-device — the latency, cost, and privacy wins are real and growing more compelling as these models get genuinely capable at narrow tasks. It's an argument that the hard engineering work has moved. Model compression is a solved-enough problem; there are good recipes for quantization and distillation and they keep improving. Fleet-scale model lifecycle management is not solved, and most teams treat it as an afterthought because it doesn't look like ML work. The teams that will do this well are the ones who stop treating the model as the deliverable and start treating the _release pipeline_ as the deliverable: versioned weights with real semantic version numbers, staged rollout infrastructure borrowed straight from mobile release engineering, device-class-aware evaluation that treats each hardware target as its own deployment surface, and a privacy-respecting telemetry design built before the first model ships, not patched in after the first silent regression. Small language models made the model small enough to live on the device. They didn't make the problem of changing your mind about that model any smaller.

Learn how to deploy ML models on AWS using Docker, Amazon ECR, and ECS Fargate. Explore containerization, scalable inference APIs, cloud deployment, and production monitoring through a practical hands-on guide.