fix(spark): Replace mapInArrow with foreachPartition for materialization#6370

Draft

abhijeet-dhumal wants to merge 7 commits intofeast-dev:masterfrom

abhijeet-dhumal:fix/spark-vector-store-materialization

Commits on May 6, 2026

fix(spark): replace mapInArrow with foreachPartition and fix session config forwarding for vector store materialization
abhijeet-dhumal
committed
fix: resolve linting and ruff check issues
abhijeet-dhumal
committed