Wilson-ZheLin/Streamline-Analyst

⭐ 488 Python added to this list on 2025-03-09 repository created 2024-01-26

Streamline Analyst is an innovative open-source AI-powered data analysis agent designed to automate and simplify the entire data analysis workflow. Leveraging Large Language Models (LLMs), this tool handles a wide range of data processing tasks including data cleaning, preprocessing, target variable identification, test set partitioning, and model selection. It aims to make data analysis accessible and efficient for users of all expertise levels by providing an intuitive interface where users simply select their data file, choose an analysis mode, and start the process. The application supports various data handling techniques such as null value management with multiple strategies (mean, median, mode filling, interpolation, new category introduction), data encoding methods (one-hot, integer mapping, label encoding), dimensionality reduction using PCA, duplicate resolution, and data transformation and normalization techniques like Box-Cox transformation. It also offers advanced features for balancing target variable entities using methods like random over-sampling, SMOTE, and ADASYN to ensure unbiased model training. Streamline Analyst recommends and trains the best-fit models based on the data characteristics, supporting a wide range of classification, clustering, and regression models including logistic regression, random forest, SVM, gradient boosting, K-means, DBSCAN, linear regression, and more. It provides real-time calculation of model performance metrics and visualizations such as confusion matrices, ROC plots, silhouette scores, and residual plots. The tool also includes a comprehensive visual analysis toolkit with single and multi-attribute visualizations, 3D plotting, word clouds, and world heat maps to enhance data insights without requiring an API key. Privacy is prioritized, with data and API keys used only once and not stored or shared. Future plans include integrating natural language processing, neural networks, and object detection capabilities to broaden its analytical scope. Streamline Analyst is accessible via a live demo and can be installed locally with Python and an OpenAI API key.

https://github.com/Wilson-ZheLin/Streamline-Analyst

3d-plottingadasynagentai-agentautomationclassification-modelsclustering-modelsdata-analysisdata-balancingdata-cleaningdata-encodingdata-privacydata-transformationdimensionality-reductionduplicate-resolutionevaluationgpt-4large-language-modelsllmsmodel-metricsmodel-selectionmodel-trainingnormalizationopen-sourcepcapreprocessingrandom-over-samplingregression-modelsresults-visualizationsmotetarget-variable-identificationtest-set-partitioningvisualization-toolkitword-cloudsworld-heat-maps

Also in NL AI Frameworks

infiniflow/ragflow

RAGFlow is an open-source Retrieval-Augmented Generation engine that leverages deep document understanding and Large Language Models to provide accurate, citation-backed question-answering from complex and diverse data sources.

ScrapeGraphAI/Scrapegraph-ai

ScrapeGraphAI is an AI-powered Python library that creates intelligent web scraping pipelines using large language models to extract structured data from websites and local documents efficiently.

pydantic/pydantic

Pydantic is a Python library for fast and extensible data validation using Python type hints, enabling developers to define and validate data models efficiently.

apache/doris

Apache Doris is a high-performance, real-time analytical database with a storage-compute integrated architecture, designed for sub-second query response and high concurrency in diverse data analysis scenarios.

business-science/ai-data-science-team

AI Data Science Team is a Python library featuring AI-powered agents that automate and accelerate common data science tasks, including data cleaning, feature engineering, machine learning, and exploratory data analysis, to improve productivity and efficiency.