Showing posts with label modeling. Show all posts
Showing posts with label modeling. Show all posts

Sunday, August 9, 2015

What the Heck are Predictive Analytics Models?


Predictive Modeling and Predictive Analytics does not lie solely in the domain of Big Data Analytics or Data Science. I am sure that there are a few “data scientist” who think they invented predictive modeling. However, predictive modeling has existed for a while and at least since World War II. In simple terms, a predictive model is a model with some predictive power. I will elaborate on this later.
I have been building predictive models since 1990. Doing the math, 2015 – 1990 = 25 years, I have been engaged in the predictive modeling business longer that data science has been around. My first book on the subject, "Fundamentals of Combat Modeling (2007), predates the "Data Science" of 2009 (see below).

How old is Data Science?

It is really a trick question. The term was first used in 1997 by C. F. Jeff Wu. In his inaugural lecture for the H. C. Carver Chair in Statistics at the University of Michigan, Professor Wu (currently at the Georgia Institute of Technology), calls for statistics to be renamed data science and statisticians to be renamed data scientists. That idea did not land on solid ground, but the topic reemerges in 2001 when William S. Cleveland publishes “Data Science: An Action Plan for Expanding the Technical Areas of the Field of Statistics.” But it is really not until 2009 that data science gains any significant following and that is also the year that Troy Sadkowsky created the data scientists group on LinkedIn as a companion to his website, datasceintists.com (which later became datascientists.net). [1]

What is Predictive Modeling?

It is not a field of statistics! Yes, we do predictive modeling in statistics, but it is really a multidisciplinary field and is based more in mathematics than in other fields. Now, if you consult the most authoritative source of factual information available to the world, Wikipedia, you will find an incorrect view of predictive modeling (of course, I do not believe what I said about Wikipedia). It was formed by people with too much time on their hands and too little exposure to other disciplines, such as physics and mathematics.

Predictive modeling may have begun as early as World War II in the Planning of Operation Overlord, the Normandy Invasion, but was certainly used in determining air defenses and bombing raid sizes (it may have appeared as early as 1840 [2]). Now, this is not an article about the history of operations research, so suffice it to say that the modern field of operational research arose during World War II. In the World War II era, operational research was defined as “a scientific method of providing executive departments with a quantitative basis for decisions regarding the operations under their control.”[3]

What is a Predictive Model?

The answer is easy: a model with some predictive power. I say that with caution, and use the word “some”, because more often than not, decision makers think that these model are absolute. Of course, they become very disappointed when the predictions do not occur as predicted. Rather than expand on my simplistic definition, I think some examples my help.

Examples of Predictive Models

The taxonomy of predictive models represented here is neither exhaustive of exclusive. In other words, there are other ways to classify predictive models, but here is one.
Times Series Models/Forecasting Models. This kind of model is a statistical model based on time series data. It uses “smoothing” techniques to account for things like seasonality in predicting or forecasting what may happen in the near future. These models are based on time-series data.


Regression Models. Time series model are technically regression models, but machine learning algorithms like auto neural networks have been employed recently in Time Series Analysis. Here I am referring to logistic regression models used in propensity modeling, and other regression models like linear regression models, robust regression models, etc. These models are based on data.

Physical models. These models are based on physical phenomena. They include 6-DoF (Degrees of Freedom) flight models, space flight models, missile models, combat attrition models (based on physical properties of munitions and equipment).


Machine Leaning Models. These include auto neural networks (ANN), support vector machines, classification trees, random forests, etc. These are based on data, but unlike statistical models, they “learn” from the data.
Weather models. These are forecasting models based on data, but the amount of data, the short interval of prediction windows and the physical phenomena involved make them much different that statistical forecasting models.

Mathematical Models. These are usually restricted to continuous time models based on differential equations or estimated using difference equations. They are often used to model very precise processes like the dynamics solid fuel rockets, or to approximate physical phenomena in the absence of actual data, like attrition coefficients approximation or direct fire effects in combat models.

Statistical Models. The first two examples, Time Series and Regression models, are statistical models. However, I list it separately because many do not realize that statistical models are mathematical models, based on mathematical statistics. Things like means and standard deviations are statistical moments, derived from mathematical moment generating functions. Every statistic in Statistics is based on a mathematical function.




What Predictive Models have I Built?

I have built predictive models in all example categories except weather models. Models I have built include Reliability, Availability and Maintainability (RAM) models for Unmanned Aerial Vehicle design; unspecified models involving satellites (unspecified because they are classified); unspecified missile models; combat attrition models; 6-DoF missiles models; missile defense models; propensity to purchase, propensity to engage, and share or wallet models regression models; time-series forecasting models for logistics; uplift (net-lift models) marketing models; ANN models as part of ensembles, classification trees, and random forests marketing models. I have also worked on descriptive and prescriptive models.

Models I have consulted on include the NASA Ares I Crew Launch Vehicle Reliability and Launch Availability; The Extended Range Multi-Purpose (ERMP) Unmanned Aerial Vehicle RAM Model, The Future Combat Systems (FCS) C4ISR family of models; FCS Logistic Decision Support System Test-Bed Model; Unspecified models (unspecified because they are classified).

References

  1. Press, G. “A Very Short History Of Data Science”, Forbes, May 28, 2013 @ 7:09 AM, Retrieved 05-29-2015.
  2. P. W. Bridgman, The Logic of Modern Physics, The MacMillan Company, New York, 1927.
  3. Operational Research in the British Army 1939–1945, October 1947, Report C67/3/4/48, UK National Archives file WO291/1301. Quoted on the dust-jacket of: Morse, Philip M, and Kimball, George E, Methods of Operations Research, 1st Edition Revised, pub MIT Press & J Wiley, 5th printing, 1954

About the Author

Jeffrey Strickland, Ph.D., is the Author of Predictive Analytics Using R and a Senior Analytics Scientist with Clarity Solution Group. He has performed predictive modeling, simulation and analysis for the Department of Defense, NASA, the Missile Defense Agency, and the Financial and Insurance Industries for over 20 years. Jeff is a Certified Modeling and Simulation professional (CMSP) and is considered one of the worlds foremost experts in mathematical modeling of combat phenomena. He has published over 250 blogs on LinkedIn, is also a frequently invited guest speaker and the author of 21 books including:
  • Operations Research using Open-Source Tools
  • Discrete Event simulation using ExtendSim
  • Crime Analysis and Mapping
  • Missile Flight Simulation
  • Mathematical Modeling of Warfare and Combat Phenomenon
  • Predictive Modeling and Analytics
  • Using Math to Defeat the Enemy
  • Verification and Validation for Modeling and Simulation
  • Simulation Conceptual Modeling
  • System Engineering Process and Practices
Connect with Jeffrey StricklandContact Jeffrey Strickland

#PredictiveModeling #PredictiveAnalytics #Analytics

Tuesday, July 27, 2010

Foreword to Fundamentals of Combat Modeling

As an assistant professor of mathematics at the United States Military Academy at the turn of the century, I was teaching applied mathematics for systems engineering and systems engineering management majors. I really had thought a great deal about the complexities of combat modeling, other than the applications I had used in teaching calculus and differential equation and applied as an Army Operations Research Analyst. That changed in the summer of 2002 when I began writing a curriculum and teaching combat modeling at the Army's premier entry level Operations Research course, and started developing a set of course notes for combat modeling.

As I transitioned from the military and moved into chief scientist and engineer roles in the defense industry, I was continually challenges to expand my understanding of combat modeling, as I supported the Army’s Future Combat Systems program. I also continued to expand the course notes I had started in 2002. When I finally found a way to move to Colorado (God’s country), it was as a contractor supporting the Missile Defense Agency (MDA), providing technical direction for the Ballistic Missile Defense System (BMDS) Threat Modeling Center.

A little over 18 months ago I started out on the adventure of compiling my course notes into a published textbook. I was recovering from a pulmonary embolism and had a lot of time to reflect on issues in combat modeling. As I write this foreword, I am recovering from a second pulmonary embolism, and I have lots of time to reflect on the people who helped me arrive to this point in my life.

First and foremost, I could not have written this without my Lord and Savior Jesus Christ. I know that may sound corny to those untouched by His hand, but I literally would not be here without His miraculous intervention. When I was in the valley, he lifted my eyes to the hills. The most prominent person on the hills was my bride of 28 years. Laurie is my best friend, my biggest supporter, and my greatest critic. When I look back, I see that she was right behind me in those valleys, helping me along my way. Thanks!

Dr. Bob Simmonds hired me to be the director of the Operations Research and Systems Analysis Military Application Course (ORSA MAC) I, without having met me. He took a chance on me and my wild ideas about operations research and teaching. He is a dear friend and supporter to this day.

Kent White and Skip Songy were fellow Spartans (now Cobham Analytics), intelligent colleagues and endearing friends. They had faith in me when others did not understand me.

Dr. Mikel Petty is the Director of the Center of Modeling, Simulation and Analysis (CMSA) at the University of Alabama in Huntsville (UAH). He likewise took a chance on me and I was employed by him for a short time. He remains a colleague and supporter.

John Pace and Wayne Grissom are friends, colleagues, and mentors in the BMDS Threat Modeling Center. They have allowed me to bring my experience to bear and have supported my every breath.

Dr. Roger Smith is a colleague whom I greatly respect. Roger encouraged me to publish my writings.

Joe Kier is my best friend and mentor. Joe showed me what right looks like.

Mariah and Evie are two little joys in my life. Together with Laurie, they provide my inspiration.