Analisis Kualitatif Kerentanan AI Agent terhadap Serangan Prompt Injection dan Strategi Mitigasinya

Authors

  • Ardian Fachreza Universitas Wahid Hasyim

DOI:

https://doi.org/10.55606/juitik.v6i2.2369

Keywords:

AI Agent, Company Data, Cyber, Large Language Models, Prompt Injection

Abstract

The development of Large Language Model (LLM)-based AI agents in enterprise environments is driving increased digital automation while expanding modern cybersecurity risks. One of the most discussed threats in AI security developments is prompt injection, a natural language-based instruction manipulation technique that can influence AI agent behavior and trigger corporate data leaks. This study aims to analyze AI agents' vulnerability to prompt injection attacks, identify their impact on corporate data security, and examine security mitigation strategies based on global industry standards. The study used a descriptive qualitative method with a threat modeling approach and contemporary cyber case studies. The results show that AI agents are highly vulnerable to direct and indirect prompt injection, especially in systems connected to tool-calling, cloud storage, corporate email, and internal databases. Analysis based on the OWASP Top 10 for LLM Applications and MITRE ATLAS frameworks shows that prompt injection is closely related to sensitive information disclosure, excessive agency, and data extraction in enterprise operational environments. Mitigation strategies such as context isolation, input validation, role-based access control, adversarial testing, and strengthening AI governance are used to reduce the risk of exploitation of modern AI agents. The research implications point to the need to develop AI security standards that are more adaptive to natural language-based threats in enterprise digital ecosystems.

References

Agarwal, D., Fabbri, A. R., Risher, B., Laban, P., Joty, S., & Wu, C.-S. (2024). Prompt leakage effect and defense strategies for multi-turn LLM interactions. arXiv preprint, 1(1), 1–10.

Chaitanya, K., & Rolla, K. J. (2024). The evolution and impact of large language models in artificial intelligence. In Algorithms in Advanced Artificial Intelligence (pp. 410–417). CRC Press.

Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., … Wang, X. (2024). When large language models meet personalization: Perspectives of challenges and opportunities. World Wide Web, 27(4), 42.

Debenedetti, E., Zhang, J., Balunovic, M., Beurer-Kellner, L., Fischer, M., & Tramèr, F. (2024). Agentdojo: A dynamic environment to evaluate prompt injection attacks and defenses for LLM agents. Advances in Neural Information Processing Systems, 37, 82895–82920.

Gartner. (2026). Gartner predicts 25% of all enterprise GenAI applications will experience at least five minor security incidents per year by 2028. https://www.gartner.com/en/newsroom/press-releases/2026-04-09-gartner-predicts-25-percent-of-all-enterprise-gen-ai-applications-will-experience-at-least-five-minor-security-incidents-per-year-by-2028

Mathew, E. (2024). Enhancing security in large language models: A comprehensive review of prompt injection attacks and defenses. Authorea Preprints.

OWASP. (2024). OWASP Top 10 for LLM applications 2025.

Rababah, B., Wu, S. T., Kwiatkowski, M., Leung, C. K., & Akcora, C. G. (2024). SoK: Prompt hacking of large language models. In 2024 IEEE International Conference on Big Data (BigData) (pp. 5392–5401). IEEE.

Rane, N. L., Tawde, A., Choudhary, S. P., & Rane, J. (2023). Contribution and performance of ChatGPT and other large language models (LLM) for scientific and research advancements: A double-edged sword. International Research Journal of Modernization in Engineering Technology and Science, 5(10), 875–899.

Sarker, I. H. (2024). Generative AI and large language modeling in cybersecurity. In AI-driven cybersecurity and threat intelligence: Cyber automation, intelligent decision-making and explainability (pp. 79–99). Springer.

Yue, C. A., Men, L. R., Mitson, R., Davis, D. Z., & Zhou, A. (2024). Artificial intelligence for internal communication: Strategies, challenges, and implications. Public Relations Review, 50(5), 102515.

Zhan, Q., Liang, Z., Ying, Z., & Kang, D. (2024). Injecagent: Benchmarking indirect prompt injections in tool-integrated large language model agents. Findings of the Association for Computational Linguistics: ACL 2024, 10471–10506.

Downloads

Published

2026-06-19

How to Cite

Ardian Fachreza. (2026). Analisis Kualitatif Kerentanan AI Agent terhadap Serangan Prompt Injection dan Strategi Mitigasinya. Jurnal Ilmiah Teknik Informatika Dan Komunikasi, 6(2), 465–475. https://doi.org/10.55606/juitik.v6i2.2369

Similar Articles

<< < 21 22 23 24 25 26 

You may also start an advanced similarity search for this article.