👩‍💻Data Analysis

AI & Data Analysis

Data analysis stands as a fundamental pillar of modern commerce and plays a crucial role in the advancement of artificial intelligence. The rapid advancement of large language models (LLM) over the last two years has significantly eased the entry barrier into the data science domain, opening up a broader array of practical applications.

News & Updates:

Vibe Analytics

The Excel spreadsheet era asked, “What happened?” The dashboard era asked, “Why did it happen?” The vibe era asks, “What insights emerge if we explore together?” Consider the gains that real-world companies are already making.

Vibe Analytics: Vibe Coding’s New Cousin Unlocks Insights | MIT Sloan Management ReviewMIT Sloan Management Review

---

Small to medium-scale datasets

For analyzing small to medium-scale datasets, simply copy and paste your data into the conversation interfaces of various Large Language Models (such as ChatGPT, Claude, etc.) and engage in a dialogue with the AI to obtain analysis results. Here are some examples of how to structure your prompts:

I want you to act as a data scientist. Imagine you’re working on a challenging project for a cutting-edge tech company. You’ve been tasked with extracting valuable insights from a large dataset related to user behavior on a new app. Your goal is to provide actionable recommendations to improve user engagement and retention. (Source:Aowsome ChatGPT Prompts)

If dealing with sensitive data, employing online large models, such as ChatGPT, Claude, etc. could pose a risk of data leakage.

When dealing with larger datasets, such as databases exported from SQL or XLSX spreadsheets, the typical copy-and-paste method becomes impractical. Currently, most major LLM applications have introduced support for uploading various types of files, allowing us to upload data files into the dialogue box and then enter a prompt for analysis.

Additionally, the GPTs store already offers a wide array of data analysis GPTs for use, accommodating uploads of various file formats like CSV, PDF, etc., to facilitate data analysis and data visualization tasks.

Data Analyst from ChatGPT

Drop in any files and I can help analyze and visualize your data.

Link: https://chat.openai.com/g/g-HMNcP6w7d-data-analyst

OpenAI Official Data Analyse Guide:

Data analysis with ChatGPT | OpenAI Help CenterOpenAI Help Center

Example:

International football results from 1872 to 2024, contain an up-to-date dataset of over 45,000 international football results. Data retrieved from Kaggle.

My question and prompt: "How has the average number of goals scored per match changed over time? Break it down by decade starting from 1870. Please plot a histogram."

Result:

Improvements to data analysis in LLMs

ChatGPT

ChatGPT has recently upgraded its data analysis capabilities, enabling it to effectively perform data cleaning, data analysis, and data visualization tasks in a wide range of scenarios.

Interact with tables and charts and add files directly from Google Drive and Microsoft OneDrive.

Improvements to data analysis in ChatGPTOpenAI

Link

Claude

AI Data Analysis Tools:

If dealing with sensitive data, using 3rd-party AI data analysis applications could pose a risk of data leakage.

Julius AI

https://julius.ai

Julius AI is a versatile AI-powered data analysis platform that offers features such as creating data visualizations, answering questions about data, performing predictive forecasting, solving math and science problems, and generating polished analyses and summaries.

Pandas AI

Chat with Database

Ask Your Database

https://www.askyourdatabase.com/

Chat with SQL Databases using AI

Second Tab

Data Visualization

Data Formulator

Data formulator from Microsoft

https://github.com/microsoft/data-formulator

Graphy

Data Analyze Agents

Google Colab Data Science Agent

The Data Science Agent in Colab uses Gemini to generate complete, executable notebooks from natural language descriptions, streamlining data analysis workflows by automating tasks like importing libraries and loading data.

https://developers.googleblog.com/en/data-science-agent-in-colab-with-gemini/

Second Tab

Data Extract Tool

Browse.ai

https://www.browse.ai/

Exa Websets

---

Large-scale datasets

For analyzing large-scale data, it's still advised to use specialized data analysis software, with many established giants in data analysis incorporating AI functionalities into their products. For instance, the industry leader Tableau has enhanced its software with an AI system, making it more user-friendly and intelligent.

Tableau

https://www.tableau.com/products/tableau-ai

Tableau AI democratizes data analysis by bringing trusted generative AI to the entire Tableau platform, accelerating time to value and reducing repetitive tasks for data analysts while empowering business users with smart, personalized insights.

Databricks

IBM Cloud Pak for Data

---

Learning Resources:

Open AI

Enabling a Data-Driven Workforce

"In this video, we share practical examples of how employees can use ChatGPT Enterprise to efficiently analyze data and uncover insights." https://openai.com/business/enabling-a-data-driven-workforce-webinar/

How to Use ChatGPT’s Advanced Data Analysis Feature

https://mitsloanedtech.mit.edu/ai/tools/data-analysis/how-to-use-chatgpts-advanced-data-analysis-feature/