Skip to content

Commit

Permalink
[E&A] Refine ML intro (#290)
Browse files Browse the repository at this point in the history
* Refine ML intro.

* Deletes references from raw-migrated-files TOC.

Co-authored-by: Brandon Morelli <brandon.morelli@elastic.co>
  • Loading branch information
szabosteve and bmorelli25 authored Feb 4, 2025
1 parent b5beadb commit a2de1d3
Show file tree
Hide file tree
Showing 4 changed files with 53 additions and 70 deletions.
60 changes: 53 additions & 7 deletions explore-analyze/machine-learning.md
Original file line number Diff line number Diff line change
@@ -1,18 +1,64 @@
---
navigation_title: Machine learning
mapped_urls:
- https://www.elastic.co/guide/en/machine-learning/current/index.html
- https://www.elastic.co/guide/en/machine-learning/current/machine-learning-intro.html
- https://www.elastic.co/guide/en/serverless/current/machine-learning.html
---

# Machine learning
# What is Elastic Machine Learning? [machine-learning-intro]

% What needs to be done: Align serverless/stateful
{{ml-cap}} features analyze your data and generate models for its patterns of behavior.
The type of analysis that you choose depends on the questions or problems you want to address and the type of data you have available.

% Scope notes: include references to trained model autoscaling where appropriate
## Unsupervised {{ml}} [machine-learning-unsupervised]

% Use migrated content from existing pages that map to this page:
There are two types of analysis that can deduce the patterns and relationships within your data without training or intervention: *{{anomaly-detect}}* and *{{oldetection}}*.

% - [ ] ./raw-migrated-files/stack-docs/machine-learning/index.md
% - [ ] ./raw-migrated-files/stack-docs/machine-learning/machine-learning-intro.md
% - [ ] ./raw-migrated-files/docs-content/serverless/machine-learning.md
[{{anomaly-detect-cap}}](machine-learning/anomaly-detection.md) requires time series data.
It constructs a probability model and can run continuously to identify unusual events as they occur. The model evolves over time; you can use its insights to forecast future behavior.

[{{oldetection-cap}}](machine-learning/data-frame-analytics/ml-dfa-finding-outliers.md) does not require time series data.
It is a type of {{dfanalytics}} that identifies unusual points in a data set by analyzing how close each data point is to others and the density of the cluster of points around it.
It does not run continuously; it generates a copy of your data set where each data point is annotated with an {{olscore}}.
The score indicates the extent to which a data point is an outlier compared to other data points.

## Supervised {{ml}} [machine-learning-supervised]

There are two types of {{dfanalytics}} that require training data sets: *{{classification}}* and *{{regression}}*.

In both cases, the result is a copy of your data set where each data point is annotated with predictions and a trained model, which you can deploy to make predictions for new data.
For more information, refer to [Introduction to supervised learning](machine-learning/data-frame-analytics/ml-dfa-overview.md#ml-supervised-workflow).

[{{classification-cap}}](machine-learning/data-frame-analytics/ml-dfa-classification.md) learns relationships between your data points in order to predict discrete categorical values, such as whether a DNS request originates from a malicious or benign domain.

[{{regression-cap}}](machine-learning/data-frame-analytics/ml-dfa-regression.md) learns relationships between your data points in order to predict continuous numerical values, such as the response time for a web request.

## Feature availability by project type [machine-learning-serverless-availability]

The {{ml-features}} that are available vary by project type:

* {{es-serverless}} projects have trained models.
* {{observability}} projects have {{anomaly-jobs}}.
* {{elastic-sec}} projects have {{anomaly-jobs}}, {{dfanalytics-jobs}}, and trained models.

## Synchronize saved objects [machine-learning-synchronize-saved-objects]

Before you can view your {{ml}} {dfeeds}, jobs, and trained models in {{kib}}, they must have saved objects.
For example, if you used APIs to create your jobs, wait for automatic synchronization or go to the **{{ml-app}}** page and click **Synchronize saved objects**.

## Export and import jobs [machine-learning-export-and-import-jobs]

You can export and import your {{ml}} job and {{dfeed}} configuration details on the **{{ml-app}}** page.
For example, you can export jobs from your test environment and import them in your production environment.

The exported file contains configuration details; it does not contain the {{ml}} models.
For {{anomaly-detect}}, you must import and run the job to build a model that is accurate for the new environment.
For {{dfanalytics}}, trained models are portable; you can import the job then transfer the model to the new cluster.
Refer to [Exporting and importing {{dfanalytics}} trained models](machine-learning/data-frame-analytics/ml-trained-models.md#export-import).

There are some additional actions that you must take before you can successfully import and run your jobs:

* The {{data-sources}} that are used by {{anomaly-detect}} {dfeeds} and {{dfanalytics}} source indices must exist; otherwise, the import fails.
* If your {{anomaly-jobs}} use custom rules with filter lists, the filter lists must exist; otherwise, the import fails.
* If your {{anomaly-jobs}} were associated with calendars, you must create the calendar in the new environment and add your imported jobs to the calendar.
36 changes: 0 additions & 36 deletions raw-migrated-files/docs-content/serverless/machine-learning.md

This file was deleted.

This file was deleted.

3 changes: 0 additions & 3 deletions raw-migrated-files/toc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -307,7 +307,6 @@ toc:
- file: docs-content/serverless/ingest-third-party-cloud-security-data.md
- file: docs-content/serverless/ingest-wiz-data.md
- file: docs-content/serverless/intro.md
- file: docs-content/serverless/machine-learning.md
- file: docs-content/serverless/maintenance-windows.md
- file: docs-content/serverless/maps.md
- file: docs-content/serverless/monitor-k8s-otel-edot.md
Expand Down Expand Up @@ -1034,8 +1033,6 @@ toc:
- file: stack-docs/elastic-stack/upgrading-kibana.md
- file: stack-docs/machine-learning/index.md
children:
- file: stack-docs/machine-learning/index.md
- file: stack-docs/machine-learning/machine-learning-intro.md
- file: stack-docs/machine-learning/ml-ad-overview.md
- file: stack-docs/machine-learning/ml-dfanalytics.md
- file: tech-content/starting-with-the-elasticsearch-platform-and-its-solutions/index.md
Expand Down

0 comments on commit a2de1d3

Please # to comment.