Shahir
joined May 8, 2025
  • What does a junior data scientist look like in 2030?

    I’m not asking whether AI can replace every data scientist tomorrow. What I’m wondering is whether we’re underestimating how much the role could change over the next 5–10 years. Tasks that once required technical expertise, writing SQL, generating code, creating dashboards, building basic models—are becoming increasingly accessible through AI tools. For someone entering the field(Read More)

    I’m not asking whether AI can replace every data scientist tomorrow.

    What I’m wondering is whether we’re underestimating how much the role could change over the next 5–10 years.

    Tasks that once required technical expertise, writing SQL, generating code, creating dashboards, building basic models—are becoming increasingly accessible through AI tools.

    For someone entering the field today, it’s hard not to wonder:

    • Which skills will still be valuable?
    • Will companies need fewer data professionals?
    • Will data science become more of a business role than a technical one?
    • How do you stay relevant when AI keeps lowering the barrier to entry?

    Curious to hear from people working in analytics, data science, engineering, and AI.

    What part of the profession do you think becomes more valuable in an AI-first world—and what part becomes less valuable?

  • How do you validate a causal inference model when you don’t have a true counterfactual?

    I’m working on an advanced analytics project where the goal is to estimate the impact of a business intervention (pricing changes, targeted campaigns, and operational improvements). The challenge is that there’s no randomized control group, and historical data is affected by seasonality, market trends, and multiple simultaneous interventions. I’ve experimented with propensity score matching and(Read More)

    I’m working on an advanced analytics project where the goal is to estimate the impact of a business intervention (pricing changes, targeted campaigns, and operational improvements). The challenge is that there’s no randomized control group, and historical data is affected by seasonality, market trends, and multiple simultaneous interventions.

    I’ve experimented with propensity score matching and difference-in-differences, but I’m struggling to determine whether the estimated treatment effect is genuinely causal or simply capturing hidden confounding variables.

    For those who’ve worked on large-scale causal inference problems:

    • How do you validate your model when a true counterfactual doesn’t exist?
    • Do you rely on synthetic controls, placebo tests, sensitivity analysis, or another validation framework?
    • How do you communicate confidence in your results to stakeholders when you can’t directly verify the “ground truth”?

    I’m interested in hearing how experienced data scientists approach this in production environments, particularly when the results drive high-value business decisions.

  • Our recommendation engine is serving irrelevant results.

    We’ve tried collaborative filtering, not working. Anyone solved this at scale?

    We’ve tried collaborative filtering, not working. Anyone solved this at scale?

  • Where do you see ChatGPT outperforming Claude, and where does it fall short?

    Both tools are widely used today, but their strengths often show up in different use cases. Some people prefer one for coding and structured tasks, while others lean toward the other for writing, reasoning, or longer context handling. From your experience: Which one performs better for your daily work? Where have you seen clear differences(Read More)

    Both tools are widely used today, but their strengths often show up in different use cases.

    Some people prefer one for coding and structured tasks, while others lean toward the other for writing, reasoning, or longer context handling.

    From your experience:

    • Which one performs better for your daily work?
    • Where have you seen clear differences in output quality or reliability?

    Looking for real-world perspectives rather than generic comparisons

  • How do you distinguish additive, semi-additive, and non-additive measures in practice?

    While working with data warehouses and BI dashboards, I often see confusion around additive, semi-additive, and non-additive measures. Conceptually, additive measures can be summed across all dimensions, semi-additive across some dimensions, and non-additive across none. But in practical implementations, especially in financial reporting, inventory tracking, or subscription analytics, the distinctions are not always straightforward. For(Read More)

    While working with data warehouses and BI dashboards, I often see confusion around additive, semi-additive, and non-additive measures.

    Conceptually, additive measures can be summed across all dimensions, semi-additive across some dimensions, and non-additive across none. But in practical implementations, especially in financial reporting, inventory tracking, or subscription analytics, the distinctions are not always straightforward.

    For example:

    • Revenue is usually additive.

    • Account balances are semi-additive.

    • Ratios like margins are non-additive.

    However, modeling and aggregation logic can vary depending on time dimensions, business rules, and reporting requirements.

    I would love to hear from the community:

    • How do you explain these differences to business stakeholders?

    • What common mistakes have you seen when modeling these measures?

    • Are there real-world scenarios where the classification becomes tricky?

    Looking forward to practical examples and insights.

Loading more threads