Complete RAG-powered system for downloading, indexing, and analyzing cement industry conference call transcripts.
Features β’ Installation β’ Usage β’ RAG Pipeline β’ Companies
This project provides an end-to-end solution for:
- Downloading conference call transcripts from multiple sources
- Processing and indexing transcripts using vector embeddings
- Analyzing business insights using RAG (Retrieval Augmented Generation)
- Querying through a user-friendly Streamlit interface
| Feature | Description |
|---|---|
| π₯ Auto Downloader | Downloads concall transcripts from Market |
| π Vector Search | ChromaDB-powered semantic search |
| π€ RAG Analysis | LangChain-based intelligent Q&A |
| π Business Insights | Pre-built analysis tasks for growth, costs, market dynamics |
| π₯οΈ Streamlit UI | Interactive web interface for queries |
| π Multi-Company | Covers 13 major cement companies |
|
|
|
- Python 3.9+
- OpenAI API Key (for embeddings and LLM)
# Clone the repository
git clone https://github.com/Mohit1053/Cement-Concall-RAG.git
cd Cement-Concall-RAG
# Create virtual environment
python -m venv .venv
.venv\Scripts\activate # Windows
source .venv/bin/activate # Linux/Mac
# Install dependencies
pip install -r requirements.txt
# Set OpenAI API Key
export OPENAI_API_KEY="your-api-key" # Linux/Mac
set OPENAI_API_KEY=your-api-key # WindowsCement_Concall_Project/
βββ π concall_downloader/ # Transcript download scripts
β βββ download_concalls_final.py # Main downloader
β βββ extract_concall_urls_2years.py
β βββ filter_concalls_2years.py
β βββ retry_failed_downloads.py
β βββ config.py # Credentials (gitignored)
βββ π Cement_Concall_Transcripts/ # Downloaded transcripts (56 files)
β βββ ACC Limited/
β βββ Ambuja Cements/
β βββ UltraTech Cement/
β βββ ... (13 companies)
βββ π rag_pipeline/ # RAG system
β βββ π core/
β β βββ vector_store.py # ChromaDB operations
β β βββ text_processor.py # Text chunking
β β βββ entity_extraction.py # Named entity extraction
β βββ π tasks/ # Business analysis tasks
β β βββ growth_analysis.py
β β βββ profitability_analysis.py
β β βββ cost_analysis.py
β β βββ market_dynamics.py
β βββ π data/vector_db_all/ # Vector database (4,185 chunks)
β βββ π scripts/ # Utility scripts
β βββ π ui/ # Streamlit interface
β βββ π tests/ # Test scripts
βββ π rag_structure_setup.py # RAG setup script
βββ π rag_requirements.txt # RAG dependencies
βββ π Cement_Companies_Concalls_*.xlsx # Master data file
cd concall_downloader
python download_concalls_final.pycd rag_pipeline
python scripts/build_index.pycd rag_pipeline/ui
streamlit run app.pyfrom rag_pipeline.core.vector_store import VectorStore
# Initialize
vs = VectorStore("data/vector_db_all")
# Query
results = vs.query("What is UltraTech's capacity expansion plan?", k=5)
for doc in results:
print(doc.page_content)βββββββββββββββββββ ββββββββββββββββββββ βββββββββββββββββββ
β PDF/Docx βββββΆβ Text Chunking βββββΆβ Embeddings β
β Transcripts β β (1000 tokens) β β (OpenAI) β
βββββββββββββββββββ ββββββββββββββββββββ βββββββββββββββββββ
β
βΌ
βββββββββββββββββββ ββββββββββββββββββββ βββββββββββββββββββ
β Response ββββββ LLM (GPT-4) ββββββ ChromaDB β
β β β Generation β β Retrieval β
βββββββββββββββββββ ββββββββββββββββββββ βββββββββββββββββββ
| Task | Description |
|---|---|
| π Growth Analysis | Revenue growth, volume trends, market share |
| π° Profitability | EBITDA margins, cost optimization, pricing power |
| π Cost Analysis | Fuel costs, logistics, power & fuel mix |
| π Market Dynamics | Demand outlook, competitive landscape |
1. "What is Shree Cement's capacity utilization rate?"
2. "Compare EBITDA margins across all companies"
3. "What are the key concerns about fuel costs?"
4. "Which companies are expanding in South India?"
5. "What is the demand outlook for FY25?"
| Metric | Value |
|---|---|
| Companies | 13 |
| Transcripts | 56 |
| Vector Chunks | 4,185 |
| Time Period | 2 Years |
This tool is for educational and research purposes only. Concall transcripts are property of respective companies.
This project is licensed under the MIT License - see the LICENSE file for details.
Built for Cement Industry Research ποΈ