• Home
  • Publications
  • InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for …

InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?

Authors
Yogesh Tripathi , Raghav Donakanti , Sahil Girhepuje , Ishan Kavathekar , Bhaskara Hanuma Vedula , Gokul S Krishnan , Shreya Goyal , Anmol Goel , Balaraman Ravindran , Ponnurangam Kumaraguru
Published In
arXiv

We evaluate LLMs on Indian legal tasks with social factors and propose a beta-weighted Legal Safety Score (LSS-beta) that combines fairness and accuracy. The study assesses safety across multiple disparity axes and explores finetuning pipelines to mitigate bias.