Navigating Trust and Safety in Multi-Agent Reinforcement Learning: Attacks, Defenses, and Future Directions

Divya Challa

doi:10.32628/IJSRST2411448

Authors

Divya Challa Sift, USA Author

DOI:

https://doi.org/10.32628/IJSRST2411448

Keywords:

Multi-Agent Reinforcement Learning, Federated Learning, Adversarial Training, Trust and Safety, Safe Exploration, Robust Policy Learning, Privacy-Preserving, Poisoning, Artificial Intelligence

Abstract

Multi-Agent Reinforcement Learning (MARL) is a key framework for building intelligent systems where multiple agents operate within a shared environment, with applications spanning autonomous driving, robotics, and distributed control systems. However, real-world deployment of MARL brings significant trust and safety challenges, as these systems are susceptible to a range of attacks that can compromise their robustness and reliability. This paper provides a comprehensive review of trust and safety attacks in MARL, categorizing various types of attacks and their implications. We explore existing defense mechanisms designed to mitigate these threats, highlighting their strengths and limitations. Additionally, we identify open challenges that remain unaddressed and propose potential future research directions to enhance the robustness and security of MARL systems.

Downloads

Download data is not yet available.

References

Joaquim, AF, and Appenzeller, S. Neuropsychiatric manifestations in rheumatoid arthritis. Autoimmun Rev. (2015) 14:1116–22. DOI: https://doi.org/10.1016/j.autrev.2015.07.015

Deshmukh, R . Rheumatoid arthritis: pathophysiology, current therapeutic strategies and recent advances in targeted drug delivery system. Mater Today Commun. (2023) 35:105877. DOI: https://doi.org/10.1016/j.mtcomm.2023.105877

Ebringer, A, Rashid, T, and Wilson, C. Rheumatoid arthritis, Proteus, anti-CCP antibodies and Karl popper. Autoimmun Rev. (2010) 9:216–23. DOI: https://doi.org/10.1016/j.autrev.2009.10.006

Lundkvist, J, Kastäng, F, and Kobelt, G. The burden of rheumatoid arthritis and access to treatment: health burden and costs. Eur J Health Econ. (2008) 8:S49–60. DOI: https://doi.org/10.1007/s10198-007-0088-8

Galloway, J, Capron, JP, De Leonardis, F, Fakhouri, W, Rose, A, Kouris, I, et al. The impact of disease severity and duration on cost, early retirement and ability to work in rheumatoid arthritis in Europe: an economic modelling study. Rheumatol Adv Pract. (2020) 4:rkaa041. DOI: https://doi.org/10.1093/rap/rkaa041

Black, RJ, Cross, M, Haile, LM, Culbreth, GT, Steinmetz, JD, Hagins, H, et al. Global, regional, and national burden of rheumatoid arthritis, 1990-2020, and projections to 2050: a systematic analysis of the global burden of disease study 2021. Lancet Rheumatol. (2023) 5:e594–610. DOI: https://doi.org/10.2139/ssrn.4478194

Pombo-Suarez, M, Maneiro Fernandez, JR, and Gomez-Reino, JJ. Adherence to treatment in patients with rheumatoid arthritis from Spain. Patient Prefer Adherence. (2021) 15:111–7. DOI: https://doi.org/10.2147/PPA.S291983

Curtis, JR, and Singh, JA. Use of biologics in rheumatoid arthritis: current and emerging paradigms of care. Clin Ther. (2011) 33:679–707. DOI: https://doi.org/10.1016/j.clinthera.2011.05.044

Fraenkel, L, Bathon, JM, England, BR, St Clair, EW, Arayssi, T, Carandang, K, et al. 2021 American College of Rheumatology Guideline for the treatment of rheumatoid arthritis. Arthritis Rheumatol. (2021) 73:1108–23.

van den Bemt, BJ, van den Hoogen, FH, Benraad, B, Hekster, YA, van Riel, PL, and van Lankveld, W. Adherence rates and associations with nonadherence in patients with rheumatoid arthritis using disease modifying antirheumatic drugs. J Rheumatol. (2009) 36:2164–70. DOI: https://doi.org/10.3899/jrheum.081204

Doddapaneni, S, Shetty, R, Sabih, I, Maddali, K, and Khera, K. Assessment of medication adherence in rheumatoid arthritis patients in a tertiary care hospital. Value Health. (2014) 17:A774. DOI: https://doi.org/10.1016/j.jval.2014.08.336

Quinlan, P, Price, KO, Magid, SK, Lyman, S, Mandl, LA, and Stone, PW. The relationship among health literacy, health knowledge, and adherence to treatment in patients with rheumatoid arthritis. HSS J. (2013) 9:42–9. DOI: https://doi.org/10.1007/s11420-012-9308-6

Chowdhury, T, Dutta, J, Noel, P, Islam, R, Gonzalez-Peltier, G, Azad, S, et al. An overview on causes of no adherence in the treatment of rheumatoid arthritis: its effect on mortality and ways to improve adherence. Cureus. (2022) 14:e24520. DOI: https://doi.org/10.7759/cureus.24520

Waimann, CA, Marengo, MF, de Achaval, S, Cox, VL, Garcia-Gonzalez, A, Reveille, JD, et al. Electronic monitoring of oral therapies in ethnically diverse and economically disadvantaged patients with rheumatoid arthritis: consequences of low adherence. Arthritis Rheum. (2013) 65:1421–9. DOI: https://doi.org/10.1002/art.37917

Tolu, S, Rezvani, A, Karacan, İ, Bugdayci, D, Küçük, HC, Bucak, ÖF, et al. Self-reported medication adherence in patients with ankylosing spondylitis: the role of illness perception and medication beliefs. Arch Rheumatol. (2020) 35:495–505. DOI: https://doi.org/10.46497/ArchRheumatol.2020.7732

Van den Bemt, BJ, Zwikker, HE, and van den Ende, CH. Medication adherence in patients with rheumatoid arthritis: a critical appraisal of the existing literature. Expert Rev Clin Immunol. (2012) 8:337–51. DOI: https://doi.org/10.1586/eci.12.23

Wolfe, F . The epidemiology of drug treatment failure in rheumatoid arthritis. Baillieres Clin Rheumatol. (1995) 9:619–32. DOI: https://doi.org/10.1016/S0950-3579(05)80305-X

Treharne, G, Lyons, A, and Kitas, G. Medication adherence in rheumatoid arthritis: effects of psychosocial factors. Psychol Health Med. (2004) 9:337–49. DOI: https://doi.org/10.1080/13548500410001721909

Kuipers, JG, Koller, M, Zeman, F, Müller, K, and Rüffer, JU. Adherence and health literacy as related to outcome of patients treated for rheumatoid arthritis: analyses of a large-scale observational study. Z Rheumatol. (2019) 78:74–81. DOI: https://doi.org/10.1007/s00393-018-0449-y

Prudente, LR, Diniz Jde, S, Ferreira, TX, Lima, DM, Silva, NA, Saraiva, G, et al. Medication adherence in patients in treatment for rheumatoid arthritis and systemic lupus erythematosus in a university hospital in Brazil. Patient Prefer Adherence. (2016) 10:863–70. DOI: https://doi.org/10.2147/PPA.S79451

Harley, CR, Frytak, JR, and Tandon, N. Treatment compliance and dosage administration among rheumatoid arthritis patients receiving infliximab, etanercept, or methotrexate. Am J Manag Care. (2003) 9:S136–43.

Chu, LH, Kawatkar, AA, and Gabriel, SE. Medication adherence and attrition to biologic treatment in rheumatoid arthritis patients. Clin Ther. (2015) 37:660–666.e8. DOI: https://doi.org/10.1016/j.clinthera.2014.10.022

Khilfeh, I, Guyette, E, Watkins, J, Danielson, D, Gross, D, and Yeung, K. Adherence, persistence, and expenditures for high-cost anti-inflammatory drugs in rheumatoid arthritis: an exploratory study. J Manag Care Spec Pharm. (2019) 25:461–7. DOI: https://doi.org/10.18553/jmcp.2019.25.4.461

Forsblad-d'Elia, H, Bengtsson, K, Kristensen, LE, and Jacobsson, LT. Drug adherence, response and predictors thereof for tocilizumab in patients with rheumatoid arthritis: results from the Swedish biologics register. Rheumatology (Oxford). (2015) 54:1186–93. DOI: https://doi.org/10.1093/rheumatology/keu455

Salaffi, F, Di Carlo, M, Farah, S, and Carotti, M. Adherence to subcutaneous anti-TNFα agents in patients with rheumatoid arthritis is largely influenced by pain and skin sensations at the injection site. Int J Rheum Dis. (2020) 23:480–7. DOI: https://doi.org/10.1111/1756-185X.13803

De Cuyper, E, De Gucht, V, Maes, S, Van Camp, Y, and De Clerck, LS. Determinants of methotrexate adherence in rheumatoid arthritis patients. Clin Rheumatol. (2016) 35:1335–9. DOI: https://doi.org/10.1007/s10067-016-3182-4

Oh, YJ, Park, B, and Moon, KW. Effect of drug adherence on treatment outcome in rheumatoid arthritis. J Rheum Dis. (2019) 26:264–72. DOI: https://doi.org/10.4078/jrd.2019.26.4.264

Li, P, Blum, MA, Von Feldt, J, Hennessy, S, and Doshi, JA. Adherence, discontinuation, and switching of biologic therapies in medicaid enrollees with rheumatoid arthritis. Value Health. (2010) 13:805–12. DOI: https://doi.org/10.1111/j.1524-4733.2010.00764.x