Author: scott
-
What Hiring Managers Actually Look For in Data Engineers
The Real Story Behind Data Engineering Hiring The job market for data engineers is brutal right now; layoffs, hiring freezes, and 200+ applicants for every decent role. But some candidates still get offers within weeks. What’s the difference? It’s not always the fanciest credentials or the longest list of technologies. It’s something more fundamental, and…
-
ML Model Evaluation: Beyond Accuracy
First of all, let me apologize for this being such a long post. But, if you can truly grasp the material presented here, it means you can distinguish a truly useful model from one that needs more work. And isn’t that really the point of what we do? Accuracy is a trap You could deploy…
-
Feature Engineering in Machine Learning: The Complete Tutorial
Feature engineering in machine learning is where you actually make money. Not the algorithm. Not the hyperparameters. The features you engineer determine whether your ML model succeeds or fails in production. Simple logistic regression with good features beats gradient boosting with raw data, every single time. I’ve watched data scientists spend three weeks optimizing XGBoost…
-
Data Governance Without the Bureaucracy: A Practical Approach
Data governance has this reputation for being the thing that slows everything down, creates endless meetings, and makes data engineers want to quit their jobs. And honestly, a lot of data governance programs deserve that reputation. But here’s the thing: you actually do need a data governance framework. Without it, you end up with data…
-
Fine-Tuning LLMs. On A Mac.
Fine-tuning a large language model used to mean shelling out serious cash for cloud GPUs or having a server farm in your basement. Not anymore. If you’ve got an Apple Silicon Mac (even an M1 like mine) you can fine-tune open source LLMs right on your laptop. No cloud costs, no data leaving your machine,…
-
AI ROI Calculation: How to Actually Measure AI Project Success
Funny thing about AI projects: everyone talks about the potential, but nobody wants to talk about the actual return on investment. And I get it; it’s messy, it’s complicated, and half the time the benefits are hard to quantify. But if you’re spending six or seven figures on an AI initiative, you better have a…
-
LLM Context Windows: What Actually Matters
The Context Window Arms Race Recently the LLM world has turned into a context window arms race. Google announces 2 million tokens. Anthropic pushes to 200K. OpenAI ups the ante. And everyone’s acting like bigger is automatically better. Here’s the thing though; most of us don’t actually need a 2 million token context window. And…
-
What is Agentic AI? Beyond Chatbots to Autonomous Systems
The AI Evolution You Need to Know About If you’ve been using ChatGPT or Claude to write emails and summarize documents, you’ve experienced the first wave of generative AI. Helpful? Absolutely. But here’s the thing: those tools are reactive. They wait for you to tell them what to do, then respond. They don’t act. Agentic…
-
Regression Models: When You Need to Predict Actual Numbers
Why Regression Instead of Classification? Up to now, we’ve been doing binary classification—yes or no, churned or didn’t churn. But what if you need to predict an actual number? Like how much revenue a customer will generate, what their lifetime value is, or how many days until they churn? That’s regression. Same scikit-learn workflow, different…
-
Build vs. Buy for Data Products: A Decision Framework
More teams than I can count waste months (sometimes years) building custom solutions when a $500/month SaaS product would have worked fine. I’ve also seen teams lock themselves into expensive platforms when a weekend of coding would have given them exactly what they needed. The “build vs. buy” decision is one of the most consequential…