Cross-Lingual Retrieval-Augmented Generation for Multilingual Knowledge Discovery

Authors

  • Tracie Maynard Department of Computer Science, University of New Hampshire, Durham, NH, USA. Author
  • Tycho Timmermans School of Computing, Clemson University, Clemson, SC, USA. Author

Keywords:

cross-lingual retrieval; retrieval-augmented generation; multilingual knowledge discovery; semantic alignment; socio-technical systems; AI governance

Abstract

Cross-lingual retrieval-augmented generation has emerged as a promising approach for multilingual knowledge discovery because it combines the broad linguistic coverage of multilingual language models with the evidentiary grounding of external retrieval systems. Yet the movement from monolingual retrieval-augmented generation to cross-lingual operation is not a simple matter of translating queries or documents. It requires coordinated decisions about semantic alignment, index design, fusion strategies, latency budgets, storage infrastructure, evaluation protocols, and governance. This paper examines cross-lingual retrieval-augmented generation as a socio-technical system rather than a single model architecture. It analyzes how multilingual encoders, dense and sparse retrieval methods, cross-lingual transfer, and attention-based fusion shape the reliability and interpretability of generated knowledge. It also considers deployment in resource-constrained and high-stakes environments, where sustainability, robustness, and fairness are inseparable from technical performance. The discussion highlights structural trade-offs between recall and precision, between language coverage and computational cost, and between centralized control and local linguistic autonomy. It further explores policy implications related to language equity, data sovereignty, privacy, and accountability. The paper argues that multilingual knowledge discovery depends less on a single breakthrough model than on layered infrastructural choices that determine whose knowledge is retrievable, whose language is treated as first-class, and whose errors are visible. A research agenda is proposed around federated indexing, language-aware governance, robust cross-lingual evaluation, and sustainable deployment.

References

1. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W., Rocktäschel, T., Riedel, S., & Kiela, D. (2020). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Advances in Neural Information Processing Systems, 33, 9459–9474.

2. Karpukhin, V., Oğuz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W. (2020). Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 6769–6781.

3. Johnson, J., Douze, M., & Jégou, H. (2019). Billion-scale similarity search with GPUs. IEEE Transactions on Big Data, 7(3), 535–547.

4. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186.

5. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020). Unsupervised Cross-lingual Representation Learning at Scale. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 8440–8451.

6. Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., Barua, A., & Raffel, C. (2021). mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer. Proceedings of NAACL-HLT 2021, 483–498.

7. Artetxe, M., & Schwenk, H. (2019). Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond. Transactions of the Association for Computational Linguistics, 7, 597–610.

8. Feng, F., Yang, Y., Cer, D., Arivazhagan, N., & Wang, W. (2022). Language-agnostic BERT Sentence Embedding. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 878–891.

9. Robertson, S., & Zaragoza, H. (2009). The Probabilistic Relevance Framework: BM25 and Beyond. Foundations and Trends in Information Retrieval, 3(4), 333–389.

10. Thakur, N., Reimers, N., Rücklé, A., Srivastava, A., & Gurevych, I. (2021). BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models. Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, 1.

11. Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., & Wang, H. (2023). Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv preprint arXiv:2312.10997.

12. Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., van den Driessche, G., Lespiau, J. B., Damoc, B., Clark, A., de Las Casas, D., Guy, A., Menick, J., Ring, R., Driessche, G., et al. (2022). Improving Language Models by Retrieving from Trillions of Tokens. Proceedings of the 39th International Conference on Machine Learning, 2206–2240.

13. Izacard, G., Lewis, P., Lomeli, M., Hosseini, L., Petroni, F., Schick, T., Dwivedi-Yu, J., Joulin, A., Riedel, S., & Grave, E. (2023). Atlas: Few-shot Learning with Retrieval Augmented Language Models. Journal of Machine Learning Research, 24(251), 1–43.

14. Deng, Q., Liu, S., Qiu, H., Long, N., Lin, W., & Chen, S. (2026, April). Unified Semantic Space and Attention-Based Fusion Framework for Multi-Source Heterogeneous Retrieval-Augmented Generation. In 2026 6th International Conference on Artificial Intelligence and Industrial Technology Applications (AIITA) (pp. 591-597). IEEE.

15. Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610–623.

16. Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P. S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., Biles, C., Brown, S., Kenton, Z., Hawkins, W., Stepleton, T., Blümel, C., Hendricks, L. A., Haas, J., Rimell, L., Isaac, W., & Gabriel, I. (2021). Ethical and social risks of harm from Language Models. arXiv preprint arXiv:2112.04359.

17. Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and Policy Considerations for Deep Learning in NLP. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 3645–3650.

18. Schwartz, R., Dodge, J., Smith, N. A., & Etzioni, O. (2020). Green AI. Communications of the ACM, 63(12), 54–63.

19. Sweeney, L. (2002). k-anonymity: A model for protecting privacy. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 10(5), 557–570.

20. Dwork, C. (2006). Differential Privacy. In Automata, Languages and Programming (ICALP 2006), 1–12. Springer.

Downloads

Published

2026-08-07

How to Cite

Cross-Lingual Retrieval-Augmented Generation for Multilingual Knowledge Discovery. (2026). International Journal of Artificial Intelligence Engineering and Systems, 1(2). https://ijaies.org/index.php/home/article/view/184