Whats happening in AI World?

Stanford’s AI index for 2021 has the following top takeaways

AI investment in drug design and discovery increased significantly:

“Drugs, Cancer, Molecular,Drug Discovery” received the greatest amount of private AI investment in 2020, with more than USD 13.8 billion, 4.5 times higher than 2019.

The industry shift continues:

In 2019, 65% of graduating North American PhDs in AI went into industry—up from 44.4% in 2010, highlighting the greater role industry has begun to play in AI development.

Generative everything:

AI systems can now compose text, audio, and images to a sufficiently high standard that humans have a hard time telling the difference between synthetic and non-synthetic outputs for some constrained applications of the technology.

AI has a diversity challenge:

In 2019, 45% new U.S. resident AI PhD graduates were white—by comparison, 2.4% were African American and 3.2% were Hispanic.

China overtakes the US in AI journal citations:

After surpassing the United States in the total number of journal publications several years ago, China now also leads in journal citations; however, the United States has consistently (and significantly) more AI conference papers (which are also more heavily cited) than China over the last decade.

The majority of the US AI PhD grads are from abroad—and they’re staying in the US:


The percentage of international students among new AI PhDs in North America continued to rise in
2019, to 64.3%—a 4.3% increase from 2018. Among foreign graduates, 81.8% stayed in the United States
and 8.6% have taken jobs outside the United States.

Surveillance technologies are fast, cheap, and increasingly ubiquitous:

The technologies necessary for large-scale surveillance are rapidly maturing, with techniques for image classification, face recognition, video analysis, and voice identification all seeing significant progress in 2020.

AI ethics lacks benchmarks and consensus:

Though a number of groups are producing a range of qualitative or normative outputs in the AI ethics domain, the field generally lacks benchmarks that can be used to measure or assess the relationship between broader societal discussions about technology development and the development of the technology itself. Furthermore, researchers and civil society view AI ethics as more important than industrial organizations.

AI has gained the attention of the U.S. Congress:

The 116th Congress is the most AI-focused congressional session in history with the number of mentions of AI in congressional record more than triple that of the 115th Congress

Amazing Popular Terms used in AI

  • CNN and ANN and RNN

CNN, ANN, and RNN are all types of neural networks used in machine learning and artificial intelligence, each with its own specific architecture and use cases:

  1. ANN (Artificial Neural Network):
    • An ANN is a computational model inspired by the way biological neural networks in the human brain process information. It consists of layers of interconnected nodes (neurons), where each connection has an associated weight. ANNs are used for a variety of tasks, including classification, regression, and pattern recognition. They are the foundational architecture for more specialized neural networks like CNNs and RNNs.
  2. CNN (Convolutional Neural Network):
    • CNNs are a type of neural network specifically designed for processing structured grid data, such as images. They use a mathematical operation called convolution to automatically and adaptively learn spatial hierarchies of features from input data. CNNs are particularly effective for image recognition and classification tasks due to their ability to capture spatial and temporal dependencies in an image through the use of filters and pooling layers.
  3. RNN (Recurrent Neural Network):
    • RNNs are designed to recognize patterns
  • Bias

In the context of machine learning and neural networks, “bias” can refer to a couple of different concepts:

  1. Bias in Neural Networks:
    • In neural networks, bias is a parameter that is added to the weighted sum of inputs to a neuron. It allows the activation function to be shifted to the left or right, which can be crucial for the model to learn the correct mapping from inputs to outputs. Bias terms help the model fit the data better by providing additional degrees of freedom. In mathematical terms, if a neuron computes a weighted sum of inputs as ( z = w_1x_1 + w_2x_2 + \ldots + w_nx_n ), the bias ( b ) modifies this to ( z = w_1x_1 + w_2x_2 + \ldots + w_nx_n + b ).
  2. Bias in Machine Learning Models:
    • Bias in this context refers to the error introduced by approximating a real-world problem, which may be complex, by a simplified model. This is part of the bias-variance tradeoff, a fundamental concept in machine learning. A model with high bias pays very little attention to the training data and oversimplifies the model, which can lead to under
  • Backward Propagation

Also known as back prop, this is the process of back tracking errors through the weights of the network after forward propagating inputs through the network. This is used by applying the chain rule in calculus.

Bounding Box

Cognitive Computing

Machine Learning

Deep Learning

corpus

Entity Annotation

Entity Extraction

Computer Vision

HyperParameter

Intent

Linguistic Annotation

Model

NLG and NLP and NLU

Overfitting

Parameter

Predictive Analysis

Supervised Learning and Unsupervised Learning and Reinforcement Learning

Semantic Annotation

Sentiment Analysis

General AI and Strong AI and Weak AI

Transfer Learning

Turing Test

GAN – Generative Adversarial Network

Heuristic

Perceptron: Single Neuron.

Logistic Regression or Sig-moid Function σ

A function used to activate the weights Network in Interval of 0,1; This function graph looks like a S which is told as Sigma in Greek. This is also known as Logistic Regression.

OpenAI is Open source : ?

OpenAI is not entirely open source. While OpenAI has released some of its models and code as open source, such as the original GPT (Generative Pre-trained Transformer) and certain versions of its reinforcement learning algorithms, many of its more advanced models, like GPT-3 and GPT-4, are not open source. These models are accessible through APIs, which allow developers to integrate them into applications, but the underlying code and model weights are not publicly available. OpenAI has taken this approach to balance the benefits of open research with concerns about safety, security, and misuse of powerful AI technologies.