KMeans Clustering

This application lets users cluster data stored on Geoscience ANALYST objects using the Scikit-Learn.KMeans clustering algorithm. Leveraging Plotly visualization tools, users are able to assess the clustering results using histogram, box, scatter, inertia and cross-correlation plots.

New user? Visit the Getting Started page.

98b57d47bfa84358adcd70736c538d49

Project Selection

Select and connect to an existing geoh5 or ui.json project file containing data.

00b889d6f1e44d75bd02bbabbad007b0

See the Project Panel page for more details.

Object and Data Selection

The Object dropdown contains a list of objects available from the target geoh5 project. Only the data selected in the Data subset dropdown are used in the clustering routine.

d05d2c9c4d4c4975ac8b5b0bd7b0903b

20b51a8003e443978eacd169b777f5a0

Downsampling

Reduce the points displayed on the clustering plots to a percentage of the original amount, with a maximum of 5000 points.

65b391427a914c1c9163b0cb260199b8

Clustering

Select the number of clusters (groups) desired.

43a61429fdd145aeb9bfa4f2434e5dcb

By default, the application will run KMeans for 2, 4, 8, 16 and 32 groups in order to draw a meaningful Inertia Curve

Clusters Color

Check the Select cluster color checkbox to display a colorpicker that can be used to assign a specific color to a given cluster group.

85f249af8f6f408a8e2de10c6b585877

Analytics

Plotting options to analyze the selected data and KMeans clusters. The default displayed plots are the Crossplot and Inertia Plot. Use the Show Analytics & Normalization checkbox to display the Histogram, Boxplot, Statistics, and Confusion Matrix.

Crossplot

See the Scatter Plot documentation for details.

[1]:
import plotly.io as io
import plotly.graph_objects as go

go.FigureWidget(io.read_json("./images/cluster/cluster_scatter.json"))

By default, the color values displayed correspond to the cluster groups.

Statistics

Display statistics for the chosen data channels using pandas.DataFrame.describe.

1661662295594e9f8314573eb24d946d

Confusion Matrix

Display the confusion matrix for the chosen data channels.

[2]:
import plotly.io as io
import plotly.graph_objects as go

go.FigureWidget(io.read_json("./images/cluster/cluster_matrix.json"))

Histograms

Display histograms for each data field.

[3]:
import plotly.io as io
import plotly.graph_objects as go

go.FigureWidget(io.read_json("./images/cluster/cluster_hist.json"))

By default, all fields are normalized between [0, 1].

Scale

Option to increase the weight of a specific data field.

93d21271e2ac4ef690ccdee3d191d502

Upper Bound

Upper bound (maximum) value used for the KMeans clustering.

67c05c4d7bb447ac82de5f191d61fe4d

Lower Bound

Lower bound (minimum) value used for the KMeans clustering.

72b8fab73c81475f9b27d62ba15d810c

Inertia

Display the cluster’s inertia, or sum squares of distances between each sample to the center of its cluster group. The optimal number of clusters is generally thought to be at the point of maximum curvature.

[4]:
import plotly.io as io
import plotly.graph_objects as go

go.FigureWidget(io.read_json("./images/cluster/cluster_inertia.json"))

Boxplot

Display boxplots describing the range of values within each cluster for a chosen data field.

[5]:
from IPython.display import IFrame
IFrame(src='./images/cluster/cluster_boxplot.html', width=700, height=650)
import plotly.io as io
import plotly.graph_objects as go

go.FigureWidget(io.read_json("./images/cluster/cluster_boxplot.json"))

Output panel

Clusters can be exported directly to the target object by clicking on the Export button. This can yield two possible outcomes:

  • If cluster data with the same name exists on the object, a new data field is created.

  • If a data field with the same name is found on the target object, values are replaced. This allows users to quickly experiment with different numbers of clusters without having to delete previous trials.

b7538361ad8d484d9cfbf10514759c96