#PySpark
LightNews LightNews
gp-pulipaka.bsky.social
Learn PySpark. #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode
geni.us/LearnPySpark
November 8, 2026 at 3:26 PM
gp-pulipaka.bsky.social
Learn #PySpark. #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode
geni.us/LearnPySpark
November 3, 2026 at 3:00 PM
sriwworldofcoding.bsky.social
200+ real interview questions, 10 deep-dive modules (SQL, Python, PySpark, Airflow, Redshift, EMR, Databricks, and AWS Architecture), and the exact framework to tackle follow-up traps.
November 4, 2026 at 5:48 PM
remoteitjobs.bsky.social
🚀 New Remote Job Alert!
💼 Position: Python/Spark or AI Developer
🏢 Company: HRBaires
🌍 Location: EU
📁 Category: Data Engineer
💰 Salary: 80,000 - 120,000 USD
🛠️ Skills: PYTHON, PYSPARK, APACHE SPARK, SPARK SQL, DELTA LAKE...
#RemoteJobs #RemoteWork #WorkFromHome #Hiring #JobOpportunity
Apply n
November 7, 2026 at 4:35 AM
saisree.bsky.social
🚀 Start your Azure Data Engineering journey with Naresh IT!

☁️ Learn Azure, Microsoft Fabric, Databricks, Kafka & PySpark.

👨‍🏫 Mr. Pavan
📅 4 Nov | ⏰ 7:30 AM IST
🏫 Classroom & Online

🔗 shorturl.at/QCgrj

#Azure #DataEngineering #NareshIT
Start your Azure Data Engineering journey with Naresh IT! ☁️ Learn Azure, Microsoft Fabric, Databricks, Kafka & PySpark.
November 2, 2026 at 12:39 PM
remoteitjobs.bsky.social
🚀 New Remote Job Alert!
💼 Position: Senior Data Engineer
🏢 Company: hireful
🌍 Location: UK
📁 Category: Data Engineer
💰 Salary: 85,000 - 85,000 GBP
🛠️ Skills: DATABRICKS, PYSPARK, SPARK SQL, DELTA LAKE, SQL...
#RemoteJobs #RemoteWork #WorkFromHome #Hiring #JobOpportunity
Apply now: https://www
November 5, 2026 at 4:36 AM
tomorrow-hire.bsky.social
⚠️ NEW JOB ALERT: #PalantirPlatformEngineer (On-site – Herndon, VA). $250K/year. Active TS/SCI with Full Scope Polygraph required. Palantir Foundry, Ontology, ETL Pipelines, PySpark & Python experience. Apply now: apply.workable.com/tomorrow-hir... #TomorrowHire
November 3, 2026 at 2:00 PM
remoteitjobs.bsky.social
🚀 New Remote Job Alert!
💼 Position: Senior Databricks Engineer
🏢 Company: Lumenalta
🌍 Location: USA
📁 Category: Data Engineer
🛠️ Skills: DATABRICKS, AWS, PYTHON, PYSPARK, SQL...
#RemoteJobs #RemoteWork #WorkFromHome #Hiring #JobOpportunity
Apply now: https://www.remoteitjobs.app/job/lumenalta-
November 3, 2026 at 10:35 AM
festivitymn.bsky.social
I used pyspark on an on prem Hadoop cluster more or less daily for 5+ years, and I’m sort of attached to it. I did different things with the output, and I pulled data from different sources, but I got pretty good at a consistent set of skills. It’s harder to say what those skills should be today.
November 1, 2026 at 2:09 AM
gp-pulipaka.bsky.social
Data Analysis with #Python and #PySpark. #BigData #Analytics #DataScience #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode
geni.us/PythonPySpark
October 29, 2026 at 6:26 AM
remoteitjobs.bsky.social
🚀 New Remote Job Alert!
💼 Position: Data Engineer
🏢 Company: Samsara
🌍 Location: USA
📁 Category: Data Engineer
🛠️ Skills: SPARKSQL, PYSPARK, DATA PIPELINES, DATA LAKE, IOT DATA...
#RemoteJobs #RemoteWork #WorkFromHome #Hiring #JobOpportunity
Apply now: https://www.remoteitjobs.app/job/samsara-
October 30, 2026 at 4:35 PM
awscli-changelog.bsky.social
[AWS CLI v2.39.2] api-change/cleanrooms
PySpark 2.0 分析テンプレート形式のサポートと、メンバーシップのデフォルトのジョブ結果設定を含め、Amazon S3 に書き込まれる保護されたジョブ結果のファイル形式 (CSV または Parquet) の選択のサポートが追加されました。
https://docs.aws.amazon.com/cli/latest/reference/cleanrooms/
#AWS
October 29, 2026 at 9:00 PM
communityaws.bsky.social
"Data lake serverless na AWS na prática: do CSV ao SQL com S3, Glue e Athena [Parte 2]" by Flavio Fox

#data-lakes #amazon-s3 #aws-glue #amazon-athena #serverless
Data lake serverless na AWS na prática: do CSV ao SQL com S3, Glue e Athena [Parte 2]
Como colocar de pé, do zero, o data lake desenhado na Parte 1. Nesta Parte 2, construo tudo com Amazon S3, AWS Glue e Amazon Athena: dados sujos de propósito, role do Glue com menor privilégio, crawler para descobrir o schema, Glue Job em PySpark convertendo CSV para Parquet particionado e partition projection no Athena. No final, a prova: a mesma consulta lendo 48 vezes menos dados.
community.aws
October 30, 2026 at 10:30 PM
edusumofficial.bsky.social
DP-600 or DP-700 first? This article compares the Fabric exams: DAX and Direct Lake vs PySpark and streaming, and where they overlap. https://www.linkedin.com/pulse/dp-700-vs-dp-600-which-fabric-exam-should-you-sit-first-kumar-fnbaf/ Which fits your daily work? #Microsoft #DP600 #MicrosoftFabric
Which Fabric Exam Comes First: Data Engineer or Analytics Engineer?
Not sure whether to take DP-600 or DP-700 first? This guide compares the Fabric Analytics Engineer and Data Engineer exams by skills measured, languages and overlap. DP-600 covers DAX, star schemas and Direct Lake; DP-700 covers orchestration, streaming and PySpark. Pick your order, then practise with DP-600 sample questions on edusum.com in 2026. #Microsoft #DP600 #MicrosoftFabric
www.linkedin.com
October 29, 2026 at 5:36 AM
gp-pulipaka.bsky.social
Essential #PySpark for Scalable Data #Analytics! #BigData #DataScience #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode
geni.us/PySpark
October 25, 2026 at 6:00 AM
lauragb.bsky.social
During a demo, I broke Data Wrangler with some dates. So I worked out some fixes and when you find a solution, you should always write a blog post! So here is my post looking at Pandas and Spark dataframes and ways to fix the delights of different date formats.

hatfullofdata.blog/data-wrangle...
Data Wrangler and Dates
Learn how to handle DMY, MDY, and YMD date formats in Microsoft Fabric notebooks using Data Wrangler, pandas, and PySpark, with explicit parsing examples.
hatfullofdata.blog
October 28, 2026 at 3:14 PM
r-dotnet.at.shendrick.net
Has anyone combined their backend development expertise in .NET with data engineering skills (such as Python, Databricks, PySpark, Apache spark, and data warehouse)? https://www.reddit.com/r/dotnet/comments/1xfyrvn/has_anyone_combined_their_backend_development/

#dotnet
October 26, 2026 at 2:45 PM
communityaws.bsky.social
"De T-SQL a PySpark: un cheat sheet para AWS Glue" by Javi Johan Rodríguez Giraldo

#aws-glue #apache-spark #etl #sql-server #data-engineering
De T-SQL a PySpark: un cheat sheet para AWS Glue
Diez patrones lado a lado, de SELECT hasta funciones ventana, para mapear tus hábitos de T-SQL a PySpark en AWS Glue sin reescribirte el cerebro.
community.aws
October 25, 2026 at 8:30 PM
communityaws.bsky.social
"T-SQL to PySpark: a cheat sheet for AWS Glue" by Javi Johan Rodríguez Giraldo

#aws-glue #apache-spark #etl #sql-server #data-engineering
T-SQL to PySpark: a cheat sheet for AWS Glue
Ten side-by-side patterns from SELECT to window functions, so you can map T-SQL habits to PySpark on AWS Glue without rewriting your brain.
community.aws
October 25, 2026 at 8:30 PM
remotedatajobs.bsky.social
12 Trending Data Opportunities Scraped in Just posted. Check them out:
◆ Joyful Craftsmen | PySpark Data Engineer
◆ Location: job
◆ Remote | Full-Time

⚡ 7902 fresh roles. See them in bio!
October 24, 2026 at 9:02 PM
📊 **Built for Agents: The Case for Spark Declarative Pipelines**

AI agents now write a growing share of production data pipelines (over 70% of SDP...

📰 Source: Databricks
🔗 Link: https://www.databricks.com/blog/built-agents-case-spark-declarative-pipelines

#ai #artificialintelligence #datascience
Built for Agents: The Case for Spark Declarative Pipelines
A 528-build benchmark shows that declarative pipeline authoring catches structural faults before execution, cutting cluster time on the builds we measured by ~34x compared to procedural PySpark.
www.databricks.com
October 25, 2026 at 8:49 PM
2meterdba.bsky.social
Depends on the language. C#, T-SQL, and PowerShell? Yes, love it. Pyspark, Yaml? O hell no.

And no greater joy than making something work, going from an idea to a thing that does what I thought of.
October 23, 2026 at 10:16 AM
📊 **Built for Agents: The Case for Spark Declarative Pipelines**

AI agents now write a growing share of production data pipelines (over 70% of SDP...

📰 Source: Databricks
🔗 Link: https://www.databricks.com/blog/built-agents-case-spark-declarative-pipelines

#ai #artificialintelligence #datascience
Built for Agents: The Case for Spark Declarative Pipelines
A 528-build benchmark shows that declarative pipeline authoring catches structural faults before execution, cutting cluster time on the builds we measured by ~34x compared to procedural PySpark.
www.databricks.com
October 23, 2026 at 7:09 PM
news.karthihegde.dev
Built for Agents: The Case for Spark Declarative Pipelines
tech_blogs_databricks

#DataEngineering
Built for Agents: The Case for Spark Declarative Pipelines
A 528-build benchmark shows that declarative pipeline authoring catches structural faults before execution, cutting cluster time on the builds we measured by ~34x compared to procedural PySpark.
www.databricks.com
October 23, 2026 at 7:06 PM
holdenkarau.com
It's been a long time, come join me reviewing Apache Spark code (mostly PySpark but a little bit of SQL and some utils too): www.youtube.com/watch?v=-P8k...
Lets do some more Spark code reviews :)
YouTube video by Holden Karau
www.youtube.com
October 21, 2026 at 9:44 PM