Uplift Modeling Using Artificial Immune System

Document Type : Research Article


1 Department of Cognitive Science, Carleton University, Ottawa, Ontario, Canada.

2 Computer Department, Khansar Campus, University of Isfahan, Isfahan, Iran.


Uplift Modeling aims to detect subgroups in a population with a specific response or reaction to an action taken on the targeted group. In these models, the Treatment set contains objects that have been exposed to some action, such as a marketing campaign or clinical treatment, while in the Control set, they have not. In this study, a novel artificial immune system-based model was designed using an AIRS classifier to solve uplift modeling problems with improved efficiency. In this approach, a predictive model was built for estimating the conditional probability of receiving the desired response from the subpopulation that has taken the action over the relevant probability of the sub-population that has not taken the action. The proposed model was tested on the Hillstorm-visit-w dataset. Experimental results showed a 138 percent improvement in the area under the uplift curve which is a measure to assess an uplift model's performance.


Main Subjects

[1] Hansotia, Behram and Rukstales, Brad. Incremental value modeling. Journal of Interactive Marketing. 16(3): 35, Elsevier Science Ltd.. 2002. [DOI ]
[2] H. Nassif and F. Kuusisto and E.S. Burnside and J.W Shavlik. Uplift Modeling with ROC: An SRL Case Study.. ILP (Late Breaking Papers). 40--45, 2013.
[3] N. Radcliffe and P. Surry and D. Patrick. Differential response analysis: Modeling true response by isolating the effect of a single action. Credit Scoring and Credit Control VI. Edinburgh, Scotland. 1999.
[4] A.A. Babalola and R. Belkacemi and S. Zarrabian and R. Craven. Adaptive Immune System reinforcement Learning-Based algorithm for real-time Cascading Failures prevention. Engineering Applications of Artificial Intelligence. 57: 118--133, Elsevier. 2017. [DOI ]
[5] M. Bateni and A. Baraani and A. Ghorbani. Alert correlation using artificial immune recognition system. International Journal of Bio-Inspired Computation. 4(3): 181--195, Inderscience Publishers. 2012. [DOI ]
[6] I. Csiszar and P.C. Shields. Information theory and statistics: A tutorial. Foundations and Trends{\textregistered} in Communications and Information Theory. 1(4): 417--528, Now Publishers, Inc.. 2004. [DOI ]
[7] Y. Deng and P.J. Bentley and A. Momshad. Improving Artificial-Immune-System-based computing by exploiting intrinsic features of computer architectures. 2016 IEEE Symposium Series on Computational Intelligence (SSCI). 1--8, 2016. [DOI ]
[8] P. Parham. The immune system. Garland Science. 2014.
[9] T. Han and K. Kobayashi. Mathematics of Information and Coding (Translations of Mathematical Monographs). Amer Mathematical Society. 2002.
[10] K. Hillstrom. The MineThatData e-mail analytics and data mining challenge. MineThatData blog. 2008.
[11] S. Jaroszewicz and L. Zaniewicz. Szekely regularization for uplift modeling. Challenges in Computational Statistics and Data Mining. 135--154, Springer. 2016. [DOI ]
[12] H. Nassif and F. Kuusisto and E.S. Burnside and D. Page and J. Shavlik and V.S. Costa. Score as you lift (SAYL): A statistical relational learning approach to uplift modeling. Joint European conference on machine learning and knowledge discovery in databases. 595--611, 2013. [DOI ]
[13] P. Rzepakowski and S. Jaroszewicz. Decision trees for uplift modeling. Data Mining (ICDM). 2010 IEEE 10th International Conference on. IEEE. 2012. [DOI ]
[14] P. Rzepakowski and S. Jaroszewicz. Decision trees for uplift modeling with single and multiple treatments. Knowledge and Information Systems. 32(2): 303--327, Springer. 2012. [DOI ]
[15] M. Soltys and s. Jaroszewicz and P. Rzepakowski. Ensemble methods for uplift modeling. Data mining and knowledge discovery. 29(6): 1531--1559, Springer. 2015. [DOI ]
[16] G.J. Szekely and M.L. Rizzo. Testing for equal distributions in high dimension. InterStat. 5(16.10): 1249--1272, 2004.
[17] G.J. Szekely and M.L. Rizzo. Hierarchical clustering via joint between-within distances: Extending Ward's minimum variance method. Journal of classification. 22(2): 151--183, Springer. 2005. [DOI ]
[18] J. Timmis and M. Neal. A resource limited artificial immune system for data analysis. Research and Development in Intelligent Systems XVII. 19--32, Springer. 2001. [DOI ]
[19] A. Watkins and J. Timmis and L. Boggess. Artificial immune recognition system (AIRS): An immune-inspired supervised learning algorithm. Genetic Programming and Evolvable Machines. 5(3): 291--317, Springer. 2004. [DOI ]
[20] L. Zaniewicz and S. Jaroszewicz. Lp-Support vector machines for uplift modeling. Knowledge and Information Systems. 53(1): 269--296, Springer. 2017. [DOI ]
[21] Y. Zhao and X. Fang and D. Simchi-Levi. A practically competitive and provably consistent algorithm for uplift modeling. 2017 IEEE International Conference on Data Mining (ICDM). 1171--1176, 2017. [DOI ]
[22] Y. Zhao and X. Fang and D. Simchi-Levi. Uplift modeling with multiple treatments and general response types. Proceedings of the 2017 SIAM International Conference on Data Mining. 588--596, 2017. [DOI ]
[23] J. Han and J. Pei and M. Kamber. Data mining: concepts and techniques. Elsevier. 2011.
[24] MH. Chen and PC. Chang and JL. Wu. A population-based incremental learning approach with artificial immune system for network intrusion detection. Engineering Applications of Artificial Intelligence. 51: 171--181, Elsevier. 2016. [DOI ]
[25] S. Jaroszewicz. Uplift Modeling. https://doi.org/10.1007/978-1-4899-7502-7_911-2 1--7, Springer US. 2020. [DOI ]
[26] LE. Jim and Islam, Nahina and Gregory, Mark A. Enhanced MANET security using artificial immune system based danger theory to detect selfish nodes. Computers \& Security. 113: 102538, Elsevier. 2022. [DOI ]
[27] N. Coulter and H. Moncayo. Artificial immune system optimized support vector machine for satellite fault detection. AIAA SCITECH 2022 Forum. 1713, 2022. [DOI ]
[28] Y. Chen and H. Wang and W. Li and J. Luo. Cost Reassignment for Improving Security of Adaptive Steganography Using an Artificial Immune System. IEEE Signal Processing Letters. 29: 1564--1568, IEEE. 2022. [DOI ]
[29] R. Jegadeeshwaran and G. Sakthivel and D. Saravanakumar and TM. Manghai and R. Sivakumar. Application of Artificial Immune Recognition System for Monitoring the Brake System Using Vibration-Based Statistical Learning. IEEE Consumer Electronics Magazine. 11(4): 85--91, IEEE. 2021. [DOI ]
[30] Lasisi, Ayodele and Ghazali, Rozaida and Ismail, Lokman Hakim and Husaini, Noor Aida. Deploying Fuzzy Rough Set and Artificial Immune System Algorithms for Air Quality Prediction. Proceedings of the 11th International Conference on Robotics, Vision, Signal Processing and Power Applications: Enhancing Research and Innovation through the Fourth Industrial Revolution. 997--1002, 2022. [DOI ]
[31] A. Ridok and N. Widodo and W.F. Mahmudy and M. Rifai. A hybrid feature selection on AIRS method for identifying breast cancer diseases. International Journal of Electrical and Computer Engineering. 11(1): 728, IAES Institute of Advanced Engineering and Science. 2021. [DOI ]
[32] M. Kastrati and B. Marenglen. Statistical relational learning: A state-of-the-art review. Journal of Engineering Technology and Applied Sciences. 4(3): 141--156, Muhammet KURULAY. 2019. [DOI ]
[33] U. Johansson and C. Sonstrod and U. Norinder and H. Bostrom. Trade-off between accuracy and interpretability for predictive in silico modeling. Future medicinal chemistry. 3(6): 647--663, Future Science. 2011. [DOI ]
[34] J. Cervantes and F. Garcia-Lamont and L. Rodriguez-Mazahua and A. Lopez. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 408: 189--215, Elsevier. 2020. [DOI ]
[35] Q. Zhou and R. Li and L. Xu and A. Fu and J. Yang and A. Gray and S. McLaughlin. RIN: Towards a Semantic Rigorous Interpretable Artificial Immune System for Intrusion Detection. International Conference on Soft Computing and its Engineering Applications. 213--224, 2022. [DOI ]
[36] S.B. Kotsiantis. Decision trees: a recent overview. Artificial Intelligence Review. 39: 261--283, Springer. 2013. [DOI ]