AI Solution in A Nutshell

Dr. Suresh Kumar Krishnan (Strasys Solutions Malaysia)

September 2025

 

No one can deny that using any AI tools nowadays is just very easy and it creates lots of excitement and disbelief how technology has changed the whole perspective of accomplishing a task. However, just using an AI tool without knowing what happens in the background after one provides the necessary inputs to churn out the required output isn’t going to help the users. This is because as a user of the AI tool, we must take accountability and responsibility by always exercising self AI Governance (AIG). So, for a start let’s understand how AI Solutions development begins as below:

 

1. Data Types:

·       Structured Data: Data that is organized in a defined manner, often on tables.

·       Unstructured Data: Data that does not have a predefined format, such as text, images, etc.

·       Semi-structured Data: Data that does not fit into a rigid structure but still contains some organizational properties.

2. Machine Learning Approaches (determines the Algorithms):

·       Supervised Learning: Learning from labeled data to make predictions.

·       Unsupervised Learning: Learning from unlabeled data to find patterns or groupings.

·       Transfer Learning: A machine learning technique where knowledge gained from one task, typically on a large dataset, is leveraged to improve performance on a different but related task.

·       Reinforcement Learning: Learning through trial and error, receiving rewards or penalties.

3. Model Types:

·       LLMs (Large Language Models): Models designed to understand and generate human language.

·       SLMs (Small Language Models): An AI model designed to understand and generate natural language, but on a smaller scale than Large Language Models (LLMs).

·       FMs (Foundation Models): a new class of large-scale AI models trained on vast, diverse datasets, enabling them to perform a wide range of tasks and serve as a common base from which more specialized applications are built.

·       VMs (Vision Models): AI systems designed to process, interpret, and understand visual data like images and videos, often by combining it with text information to perform tasks such as object detection, image captioning, and visual question answering. Key types include Large Vision Models (LVMs), which specialize in visual understanding, and Vision Language Models (VLMs), which integrate vision and language to bridge the gap between what a machine sees and how it's described. 

·       AMs (Audio Models): AI systems designed to process, understand, and generate audio, including speech, music, and environmental sounds. These models perform tasks such as Automatic Speech Recognition (ASR), converting spoken language into text, and Text-to-Speech (TTS), transforming text into natural-sounding speech. They also handle audio classification (identifying sounds), music generation, and creating custom voices, often leveraging techniques like speech-to-speech conversion for more nuanced results. 

4. Model Evaluation and Refinement

·       Fine Tuning and Hyperparameter Testing: Fine-tuning is the process of taking a pre-trained AI model and retraining it on a smaller, specific dataset to adapt its knowledge for a new, related task or domain. Hyperparameter testing (or tuning) is a separate but crucial process of identifying the optimal values for configuration settings (hyperparameters) that control a model's training process, such as its learning rate or the number of layers, to achieve the best possible performance.

5. Deployment and Integration

·       Deployment of AI Solution to User: integrating a trained AI model into a real-world, production environment, making it accessible and operational for actual users and systems to interact with. This final stage of the AI lifecycle transitions a theoretical model into a practical tool that generates insights, automates tasks, or supports data-driven decisions, enabling businesses to realize the value of their AI investments.

6. AI System Feedback and AI Governance (AIG)

·       HRLF (Human Reinforcement Learning Feedback): A machine learning technique where an AI model learns to align its outputs with human preferences by incorporating direct human feedback into its training process.

·       AMLF (Autonomous Machine Learning Feedback): An AI system where an AI model receives performance feedback and automatically adjusts its own algorithms to improve, without continuous human intervention. This creates a continuous learning loop, using mechanisms like Reinforcement Learning from Human Feedback (RLHF), self-supervised learning, or other forms of self-correction to refine its responses and achieve goals more effectively. The system effectively learns from its "mistakes" and successes by incorporating feedback into its decision-making process.

·       AIG (Artificial Intelligence Governance): A framework of policies, rules, ethical principles, and standards that guide the ethical and responsible development, deployment, and use of Artificial Intelligence systems to ensure safety, fairness, transparency, and alignment with societal values and human rights. It involves creating oversight mechanisms to manage risks like AI bias, data privacy infringement, and system misuse, while fostering trust and innovation.

7. AI Risk Management

·       Data Risk: The potential negative impacts arising from the collection, use, and management of data by AI systems, including data breaches, bias and discrimination from flawed data, privacy violations, and misuse of sensitive information. These risks are amplified by AI's need for massive datasets and the unique vulnerabilities introduced by its complex and sometimes not so transparent processes.

·       Model Risk: The potential for adverse consequences or losses due to the inadequate design, implementation, or use of AI models in decision-making processes. It encompasses risks like data inaccuracies, flawed algorithms, model drift, bias in outputs, and the misuse of model outputs. Effective Model Risk Management (MRM) is crucial to identify, measure, and control these risks throughout a model's lifecycle, ensuring reliable and beneficial AI applications.

·       Infrastructure Risk: The dangers that arise when AI systems, their data, and their underlying hardware and software are compromised, mismanaged, or fail, leading to malfunctions or harmful consequences for the critical infrastructure they support. These risks can include cybersecurity threats like data poisoning, adversarial attacks, and model manipulation, as well as operational risks from system failures, design flaws, and excessive resource demands that lead to financial losses or service disruptions. User Risk: Risks associated with user interactions and data privacy. 

·       User Risk: the potential for human activity or user behavior to negatively impact AI systems or the organizations they serve, often manifesting as the risk of an identity being compromised, leaking credentials, unauthorized use of AI tools, or human error leading to system misbehavior or security breaches. This concept goes beyond traditional cybersecurity, encompassing the human element in the broader lifecycle of AI adoption and operation, with a focus on visibility, management, and mitigation of human-driven risks to ensure secure and beneficial AI usage.

8. Holistic Problem Solving and Continuous Improvement

 

·       Regularly assess the performance of each component using predefined metrics.

·       Encourage iterative development practices where components are updated based on feedback from both human users and autonomous systems.

Additional input on AI Eco-System

1. Historical Context and Evolution of AI as a Field

The original document presents AI as it exists today, largely focused on contemporary machine learning approaches, but AI has a rich history spanning over 70 years:

• Early Foundations (1940s-1950s): The conceptual groundwork was laid by figures like Alan Turing (Turing Test), Warren McCulloch and Walter Pitts (neural networks), and Claude Shannon (information theory). The 1956 Dartmouth Conference, organized by John McCarthy, Marvin Minsky, Nathaniel Rochester, and Claude Shannon, officially coined the term "artificial intelligence" and established it as a research field.
• Initial Optimism (1950s-1970s): This period saw the development of early AI programs like the Logic Theorist (1956), ELIZA (1966), and SHRDLU (1970). Researchers made bold predictions about achieving human-level intelligence within decades.
• First AI Winter (1974-1980): When early promises weren't fulfilled, funding dried up as researchers encountered fundamental challenges like limited computational power, the combinatorial explosion problem, and insufficient data.
• Expert Systems Era (1980s): AI research shifted toward rule-based expert systems that encoded domain knowledge. Companies like Symbolics and Lisp Machines flourished, but these systems proved brittle and difficult to maintain.
• Second AI Winter (late 1980s-early 1990s): The limitations of expert systems became apparent, leading to another funding downturn.
• Statistical Learning Revolution (1990s-2000s): Machine learning approaches based on statistics and probability theory gained prominence, moving away from the symbolic approaches of earlier decades. Support Vector Machines, Bayesian networks, and Hidden Markov Models became important tools.
• Deep Learning Renaissance (2010s-Present): The availability of big data, increased computational power (especially GPUs), and algorithmic innovations led to breakthroughs in deep learning, culminating in the large language models and foundation models mentioned in the original document.

This historical context is crucial because it shows that AI has gone through multiple paradigms, with different approaches rising and falling in prominence. The current machine learning dominance is just the latest chapter in this evolving story.

2. Theoretical Foundations Beyond Machine Learning

The original document focuses heavily on machine learning approaches, but AI has several other important theoretical foundations:

• Symbolic AI (Good Old-Fashioned AI - GOFAI): This approach, dominant in early AI research, assumes that intelligence can be achieved through the manipulation of symbols and explicit rules. It includes:
• Logic-based systems (propositional and first-order logic)
• Production rules (IF-THEN statements)
• Semantic networks and frames for knowledge representation
• Unlike machine learning's statistical approach, symbolic AI emphasizes explicit, interpretable reasoning
• Knowledge Representation: This subfield focuses on how to present information about the world in a form that a computer system can utilize to solve complex tasks. Key approaches include:
• Ontologies (formal representations of knowledge as a set of concepts)
• Description logics
• Graph-based representations
• These are crucial for systems that need to reason about complex relationships and constraints
• Cognitive Architectures: These are computational models inspired by cognitive psychology, aiming to model human cognition. Examples include:
• ACT-R (Adaptive Control of Thought-Rational)
• SOAR (State, Operator, and Result)
• These architectures integrate perception, memory, decision-making, and action into unified systems
• Evolutionary Computation: Inspired by biological evolution, these approaches include:
• Genetic algorithms
• Evolutionary strategies
• Genetic programming
• These methods optimize solutions through processes analogous to natural selection

These theoretical foundations offer alternative approaches to problem-solving that complement or sometimes contrast with machine learning. For example, while machine learning excels at pattern recognition in large datasets, symbolic approaches can provide more interpretable reasoning and better handling of abstract concepts.

3. Core AI Subfields Like Robotics, Planning, Reasoning, and Expert Systems

The original document mentions various model types but doesn't cover these core AI subfields that have been fundamental to the discipline:

• Robotics: This subfield integrates AI with physical machines that can interact with the physical world. It encompasses:
• Perception (sensing the environment)
• Localization and mapping (knowing where the robot is)
• Motion planning (determining how to move)
• Control (executing movements)
• Human-robot interaction
• Robotics require integrating perception, reasoning, and action in real-time, making it a uniquely challenging AI application
• Automated Planning: This involves generating sequences of actions to achieve specific goals. Key aspects include:
• Classical planning (deterministic, fully observable environments)
• Temporal planning (handling time constraints)
• Probabilistic planning (dealing with uncertainty)
• Hierarchical planning (decomposing complex problems)
• Planning is fundamental for any AI system that needs to take action in the world
• Automated Reasoning: This subfield focuses on how machines can reach conclusions from given information. It includes:
• Deductive reasoning (drawing specific conclusions from general principles)
• Inductive reasoning (inferring general principles from specific examples)
• Abductive reasoning (finding the best explanation for observations)
• Common-sense reasoning (drawing conclusions that humans would find obvious)
• Reasoning systems often use formal logic to ensure sound and complete inference
• Expert Systems: As mentioned earlier, these were a dominant paradigm in the 1980s. They:
• Encode domain expertise from human experts
• Use inference engines to apply this knowledge to specific cases
• Provide explanations for their conclusions
• Operate in narrow domains (e.g., medical diagnosis, mineral exploration)
• While largely superseded by machine learning for many applications, they pioneered important concepts in knowledge representation and explainable AI
• Natural Language Processing (NLP): While mentioned in relation to LLMs, NLP as a field has a much broader history and scope, including:
• Syntactic parsing (analyzing sentence structure)
• Semantic analysis (understanding meaning)
• Discourse analysis (understanding context across multiple sentences)
• Pragmatics (understanding language in context)
• Machine translation
• Early NLP relied heavily on symbolic and rule-based approaches before the statistical and neural approaches of today

These subfields represent different ways of thinking about intelligence and problem-solving, often requiring different techniques than those emphasized in contemporary machine learning.

4. Mathematical and Algorithmic Foundations

The original document mentions algorithms but doesn't delve into the deep mathematical foundations that underpin AI:

• Computational Complexity Theory: This branch of computer science classifies problems according to their inherent difficulty. In AI, it helps us understand:
• Which problems are computationally feasible to solve
• Which problems are intractable (require exponential time)
• Which problems are undecidable (cannot be solved by any algorithm)
• This understanding guides AI research toward problems that are solvable
• Graph Theory: Many AI problems can be represented as graphs, including:
• Search problems (finding paths through state spaces)
• Knowledge representation (semantic networks)
• Constraint satisfaction problems
• Social network analysis
• Graph algorithms (like Dijkstra's, A*, and PageRank) are fundamental to many AI systems
• Probability and Statistics: While mentioned in the context of machine learning, these mathematical fields have broader importance in AI:
• Bayesian networks for reasoning under uncertainty
• Hidden Markov Models for sequential data
• Probabilistic graphical models
• Statistical inference methods
• These tools allow AI systems to handle inherent uncertainty in real-world problems
• Optimization Theory: Many AI problems can be framed as optimization problems, including:
• Linear and nonlinear programming
• Convex optimization
• Combinatorial optimization
• Multi-objective optimization
• Optimization algorithms (gradient descent, simulated annealing, genetic algorithms) are central to training machine learning models
• Information Theory: Founded by Claude Shannon, this field provides tools for quantifying information, which is crucial for:
• Feature selection
• Model evaluation
• Compression algorithms
• Communication between AI components
• Concepts like entropy, mutual information, and the information bottleneck are widely used in AI
• Game Theory: This mathematical framework for strategic decision-making is important for:
• Multi-agent systems
• Adversarial reasoning
• Mechanism design
• Auction algorithms
• Game-theoretic concepts help AI systems reason about other intelligent agents

These mathematical foundations provide the rigorous underpinnings for AI algorithms and help us understand the theoretical limits of what AI systems can achieve.

5. Interdisciplinary Nature of AI

The original document presents AI as a relatively self-contained field, but it has always been deeply interdisciplinary:

• Cognitive Science: This interdisciplinary study of mind and intelligence has profoundly influenced AI through:
• Theories of human problem-solving (e.g., Newell and Simon's work)
• Models of memory and learning
• Understanding of perception and attention
• Cognitive architecture inspired by human cognition
• The relationship between AI and cognitive science has been bidirectional, with each field informing the other
• Neuroscience: The study of the nervous system has provided inspiration for:
• Neural networks (originally inspired by biological neurons)
• Models of visual processing (convolutional neural networks)
• Understanding of reinforcement learning (dopamine systems)
• Neuromorphic computing (hardware designed to mimic neural systems)
• While modern neural networks are often quite different from their biological counterparts, neuroscience continues to provide valuable insights
• Linguistics: The scientific study of language has contributed to:
• Theories of syntax and grammar
• Understanding of semantics and pragmatics
• Models of language acquisition
• Cross-linguistic studies that inform machine translation
• Early NLP systems were heavily based on linguistic theories, and while modern statistical approaches have dominated, linguistic knowledge remains valuable
• Philosophy: Philosophical inquiry has addressed fundamental questions relevant to AI:
• What is intelligence?
• Can machines think?
• What is consciousness?
• How do we represent knowledge?
• Ethical frameworks for AI
• Philosophical perspectives help frame the goals and limits of AI research
• Psychology: The study of human behavior and mental processes has informed:
• Models of learning and memory
• Understanding of human problem-solving strategies
• Theories of perception and categorization
• Human-computer interaction principles
• Psychological research provides both inspiration and evaluation criteria for AI systems
• Economics: Economic principles are relevant to:
• Rational decision-making models
• Game theory for multi-agent systems
• Mechanism design for AI systems interacting with humans
• Understanding the economic impact of AI technologies

This interdisciplinary nature means that advances in AI often come from cross-pollination with other fields, and a complete understanding of AI requires appreciation of these diverse perspectives.

6. Broader Societal Impacts and Ethical Considerations Beyond Governance

While the original document mentions AI governance and risk management, it doesn't fully explore the broader societal implications of AI:

• Economic Impact: AI is transforming economies in profound ways:
• Automation of jobs and potential displacement of workers
• Creation of new industries and job categories
• Productivity gains and economic growth
• Changing skill requirements and education needs
• Wealth distribution effects
• Understanding these economic effects is crucial for developing policies that ensure AI benefits are broadly shared
• Social and Cultural Impact: AI is reshaping society and culture:
• Changes in how we communicate and interact
• Impact on social relationships and community formation
• Transformation of creative industries and artistic expression
• Influence on cultural production and consumption
• Changes in how information is created and disseminated
• These cultural changes are often subtle but profound
• Democracy and Governance: AI presents challenges and opportunities for democratic systems:
• Impact on political discourse (e.g., through social media algorithms)
• Potential for manipulation through targeted messaging
• AI in surveillance and its implications for civil liberties
• Algorithmic decision-making in government services
• Potential for AI to improve democratic participation
• These issues go beyond technical governance to fundamental questions about how societies organize themselves
• Existential Risks: Some researchers have raised concerns about potential long-term risks from advanced AI:
• Misalignment between AI goals and human values
• Loss of human control over powerful AI systems
• Concentration of power in entities controlling advanced AI
• Potential for AI to be used in destabilizing ways
• While controversial, these discussions have influenced research directions and policy debates
• Global Dynamics: AI is reshaping international relations:
• Competition for AI leadership between nations
• Military applications of AI and AI arms races
• Digital divides between developed and developing countries
• Global governance challenges for cross-border AI systems
• Technology transfer and intellectual property issues
• These geopolitical considerations have significant implications for AI development and deployment
• Human Identity and Meaning: As AI systems become more capable, they raise profound questions:
• What makes humans unique?
• How do we find meaning in a world with artificial intelligence?
• How does AI change our understanding of consciousness and intelligence?
• What is the relationship between human and artificial minds?
• These philosophical questions are becoming increasingly practical as AI systems become more integrated into our lives

These broader societal impacts go beyond the technical governance issues mentioned in the original document and touch on fundamental questions about how AI will shape our collective future.

7. Hardware and Computational Aspects Beyond Infrastructure Risk

The original document mentions infrastructure risk but doesn't explore the deep relationship between hardware advances and AI progress:

• Specialized AI Hardware: The development of specialized hardware has been crucial to AI advances:
• GPUs (Graphics Processing Units): Originally designed for graphics, their parallel architecture proved ideal for neural network training
• TPUs (Tensor Processing Units): Google's custom chips designed specifically for neural network computations
• FPGAs (Field-Programmable Gate Arrays): Reconfigurable hardware that can be optimized for specific AI algorithms
• Neuromorphic Computing: Hardware designed to mimic the structure and function of biological neural networks
• These specialized hardware developments have dramatically accelerated AI capabilities
• Quantum Computing: While still in early stages, quantum computing has the potential to revolutionize AI:
• Exponential speedup for certain classes of problems
• New algorithms for optimization and search
• Potential for more efficient training of certain types of models
• Quantum machine learning as an emerging research field
• Quantum computing represents a potentially transformative technology for AI
• Edge Computing: The trend toward processing data closer to where it's collected has significant implications for AI:
• Reducing latency for real-time AI applications
• Enabling AI in devices with limited connectivity
• Privacy benefits from keeping data local
• Energy efficiency considerations
• Specialized hardware for edge AI (e.g., Apple's Neural Engine)
• Edge computing is enabling AI applications that would be impractical with cloud-only approaches
• Distributed Computing Frameworks: Large-scale AI systems rely on sophisticated distributed computing infrastructure:
• Frameworks like TensorFlow, PyTorch, and Apache Spark for distributed training
• Parameter servers and model parallelism techniques
• Federated learning approaches that enable training across distributed devices
• These frameworks enable the training of models that would be impossible on single machines
• Energy Efficiency and Sustainability: The environmental impact of AI computing is becoming increasingly important:
• The substantial energy requirements of training large models
• Research into more efficient algorithms and hardware
• Carbon footprint considerations for AI systems
• Green computing initiatives in data centers
• These environmental considerations are becoming central to AI development
• Hardware-Software Co-design: The interplay between hardware and software in AI systems:
• Designing algorithms that take advantage of specific hardware capabilities
• Developing hardware optimized for emerging AI algorithms
• The virtuous cycle where hardware advances enable new algorithms, which in turn drive new hardware development
• This co-design has been fundamental to AI progress

These hardware and computational aspects go far beyond infrastructure risk considerations and represent a fundamental driver of AI capabilities and progress.

In conclusion, while the original document provides a useful overview of contemporary AI implementation, a complete understanding of AI requires appreciation of its historical development, diverse theoretical foundations, core subfields, mathematical underpinnings, interdisciplinary nature, broader societal impacts, and the crucial role of hardware and computing infrastructure. These elements together provide a more holistic view of artificial intelligence as scientific discipline, technological endeavor, and social phenomenon.