Class code for Comparison Study

Simulation

Method	Category	JIT Enabled	Multicore	Citation number
LOF (Breunig et al., 2000)	Proximity	No	Yes
kNN (Ramaswamy et al., 2000)	Proximity	No	Yes
AvgkNN (Angiulli and Pizzuti, 2002)	Proximity	No	Yes
CBLOF (He et al., 2003)	Proximity	Yes	No
OCSVM (Sch ̈olkopf et al., 2001)	Linear Model	No	No
LOCI (Papadimitriou et al., 2003)	Proximity	Yes	No	1157
PCA (Shyu et al., 2003)	Linear Model	No	No
MCD (Hardin and Rocke, 2004)	Linear Model	No	No
Feature Bagging (Lazarevic and Kumar, 2005)	Ensembling	No	Yes	705
ABOD (Kriegel et al., 2008)	Proximity	Yes	No	884
Isolation Forest (Liu et al., 2008)	Ensembling	No	Yes
HBOS (Goldstein and Dengel, 2012)	Proximity	Yes	No
SOS (Janssens et al., 2012)	Proximity	Yes	No
AutoEncoder (Sakurada and Yairi, 2014)	Neural Net	Yes	No
AOM (Aggarwal and Sathe, 2015)	Ensembling	No	No
MOA (Aggarwal and Sathe, 2015)	Ensembling	No	No
SO-GAAL (Liu et al., 2019)	Neural Net	No	No
MO-GAAL (Liu et al., 2019)	Neural Net	No	No
XGBOD (Zhao and Hryniewicki, 2018b)	Ensembling	No	Yes	93
LSCP (Zhao et al., 2019)	Ensembling	No	No	97

---

ex - The Stanford bunny data generated using the pygsp package is a common graphics 3D test model and NN-graph. It has 2503 data. We use filter.Heat in this package and it calculate data by \(\hat{g}(x) = \exp(\frac{-\tau x}{\lambda_{max}})\) and \(\tau\) is 75. We use Chebyshev polynomial approximation on this filter. We make zero vector whixh size is 2503, and put -3000 to one value to use a Lanczos approximation. A Lanczos approximation will resize signals by flattened.

ref: https://pygsp.readthedocs.io/en/v0.5.1/reference/filters.html

---

\(r = 5 + \cos(\frac{12\pi - (-\pi)}{n})\times i , (i=1,2,\dots , n)\)

\(r \cos(\frac{\pi - 2\times \pi /n - (-\pi) }{n}\times i)),(i=1,2,\dots ,n)\)

\(r \sin((\frac{\pi - 2\times \pi /n - (-\pi) }{n}\times i)),(i=1,2,\dots ,n)\)

\(f = 10 \times (\frac{6 \pi}{n} \times i),(i=1,2, \dots , n)\)

---

#sample(c(runif(25,-4,-3), runif(25,3,4), rep(0,900))), sd=5, >12
round(fourteen_linear,3)

	Accuracy	Precision	Recall	F1
GODE	0.935	0.934	0.999	0.965
LOF (Breunig et al., 2000)	0.848	0.917	0.913	0.915
kNN (Ramaswamy et al., 2000)	0.948	0.971	0.971	0.971
CBLOF (He et al., 2003)	0.896	0.919	0.970	0.944
OCSVM (Sch ̈olkopf et al., 2001)	0.920	0.956	0.956	0.956
MCD (Hardin and Rocke, 2004)	0.960	0.978	0.978	0.978
Feature Bagging (Lazarevic and Kumar, 2005)	0.948	0.971	0.971	0.971
ABOD (Kriegel et al., 2008)	0.940	0.942	0.994	0.968
Isolation Forest (Liu et al., 2008)	0.845	0.976	0.849	0.908
HBOS (Goldstein and Dengel, 2012)	0.897	0.923	0.967	0.944
SOS (Janssens et al., 2012)	0.897	0.923	0.967	0.944
SO-GAAL (Liu et al., 2019)	0.856	0.918	0.922	0.920
MO-GAAL (Liu et al., 2019)	0.852	0.918	0.918	0.918
LSCP (Zhao et al., 2019)	0.948	0.971	0.971	0.971

#sample(c(runif(25,-5,-3), runif(25,3,5), rep(0,950))), sd=5
round(fourteen_linear,3)

	Accuracy	Precision	Recall	F1
GODE	0.964	0.963	1.000	0.981
LOF (Breunig et al., 2000)	0.889	0.976	0.905	0.939
kNN (Ramaswamy et al., 2000)	0.942	0.996	0.943	0.969
CBLOF (He et al., 2003)	0.952	0.975	0.975	0.975
OCSVM (Sch ̈olkopf et al., 2001)	0.931	0.989	0.938	0.963
MCD (Hardin and Rocke, 2004)	0.944	0.997	0.944	0.970
Feature Bagging (Lazarevic and Kumar, 2005)	0.940	0.994	0.942	0.968
ABOD (Kriegel et al., 2008)	0.976	0.987	0.987	0.987
Isolation Forest (Liu et al., 2008)	0.831	0.997	0.824	0.903
HBOS (Goldstein and Dengel, 2012)	0.896	0.969	0.920	0.944
SOS (Janssens et al., 2012)	0.896	0.969	0.920	0.944
SO-GAAL (Liu et al., 2019)	0.884	0.961	0.915	0.937
MO-GAAL (Liu et al., 2019)	0.886	0.961	0.917	0.939
LSCP (Zhao et al., 2019)	0.944	0.997	0.944	0.970

#sample(c(runif(25,-7,-5), runif(25,5,7), rep(0,950))), sd=5
round(fourteen_linear,3)

	Accuracy	Precision	Recall	F1
GODE	0.988	0.988	1.000	0.994
LOF (Breunig et al., 2000)	0.871	0.962	0.900	0.930
kNN (Ramaswamy et al., 2000)	0.950	1.000	0.947	0.973
CBLOF (He et al., 2003)	0.972	0.985	0.985	0.985
OCSVM (Sch ̈olkopf et al., 2001)	0.940	0.994	0.942	0.968
MCD (Hardin and Rocke, 2004)	0.950	1.000	0.947	0.973
Feature Bagging (Lazarevic and Kumar, 2005)	0.950	1.000	0.947	0.973
ABOD (Kriegel et al., 2008)	0.988	0.994	0.994	0.994
Isolation Forest (Liu et al., 2008)	0.889	1.000	0.883	0.938
HBOS (Goldstein and Dengel, 2012)	0.960	0.978	0.980	0.979
SOS (Janssens et al., 2012)	0.960	0.978	0.980	0.979
SO-GAAL (Liu et al., 2019)	0.895	0.969	0.919	0.943
MO-GAAL (Liu et al., 2019)	0.896	0.970	0.919	0.944
LSCP (Zhao et al., 2019)	0.950	1.000	0.947	0.973

# sample(c(runif(25,-7,-5), runif(25,5,7), rep(0,950)))
round(fourteen_orbit,3)

	Accuracy	Precision	Recall	F1
GODE	0.997	0.997	1.000	0.998
LOF (Breunig et al., 2000)	0.886	0.987	0.892	0.937
kNN (Ramaswamy et al., 2000)	0.948	0.999	0.946	0.972
CBLOF (He et al., 2003)	0.918	0.957	0.957	0.957
OCSVM (Sch ̈olkopf et al., 2001)	0.923	0.988	0.931	0.958
MCD (Hardin and Rocke, 2004)	0.866	0.953	0.903	0.928
Feature Bagging (Lazarevic and Kumar, 2005)	0.912	0.979	0.927	0.952
ABOD (Kriegel et al., 2008)	0.988	0.994	0.994	0.994
Isolation Forest (Liu et al., 2008)	0.378	0.997	0.346	0.514
HBOS (Goldstein and Dengel, 2012)	0.881	0.961	0.912	0.936
SOS (Janssens et al., 2012)	0.881	0.961	0.912	0.936
SO-GAAL (Liu et al., 2019)	0.876	0.959	0.908	0.933
MO-GAAL (Liu et al., 2019)	0.950	0.950	1.000	0.974
LSCP (Zhao et al., 2019)	0.948	0.999	0.946	0.972

round(fourteen_bunny,3)

	Accuracy	Precision	Recall	F1
GODE	0.995	0.995	0.999	0.997
LOF (Breunig et al., 2000)	0.928	0.957	0.969	0.963
kNN (Ramaswamy et al., 2000)	0.940	0.996	0.941	0.968
CBLOF (He et al., 2003)	0.978	0.989	0.987	0.988
OCSVM (Sch ̈olkopf et al., 2001)	0.932	0.991	0.937	0.963
MCD (Hardin and Rocke, 2004)	0.935	0.993	0.938	0.965
Feature Bagging (Lazarevic and Kumar, 2005)	0.915	0.982	0.928	0.954
ABOD (Kriegel et al., 2008)	0.977	0.989	0.987	0.988
Isolation Forest (Liu et al., 2008)	0.794	0.995	0.788	0.879
HBOS (Goldstein and Dengel, 2012)	0.895	0.969	0.919	0.944
SOS (Janssens et al., 2012)	0.895	0.969	0.919	0.944
SO-GAAL (Liu et al., 2019)	0.952	0.952	1.000	0.975
MO-GAAL (Liu et al., 2019)	0.952	0.952	1.000	0.975
LSCP (Zhao et al., 2019)	0.940	0.996	0.941	0.967

Import

import numpy as np
import matplotlib.pyplot as plt
import matplotlib
from sklearn.svm import OneClassSVM
from sklearn.linear_model import SGDOneClassSVM
from sklearn.kernel_approximation import Nystroem
from sklearn.pipeline import make_pipeline

import pandas as pd
from sklearn.neighbors import LocalOutlierFactor

import rpy2
import rpy2.robjects as ro 
from rpy2.robjects.vectors import FloatVector 
from rpy2.robjects.packages import importr

from sklearn.datasets import fetch_kddcup99, fetch_covtype, fetch_openml
from sklearn.preprocessing import LabelBinarizer

import tqdm

from pygsp import graphs, filters, plotting, utils

from sklearn.metrics import confusion_matrix
from sklearn.metrics import precision_score, recall_score, f1_score, accuracy_score

import plotly.graph_objects as go
from IPython.display import HTML

import plotly.express as px

from sklearn.covariance import EmpiricalCovariance, MinCovDet

from alibi_detect.od import IForest
# from pyod.models.iforest import IForest

from pyod.models.abod import ABOD
from pyod.models.cblof import CBLOF
import seaborn as sns

from PyNomaly import loop

from sklearn import svm

from pyod.models.lscp import LSCP
from pyod.models.hbos import HBOS

from pyod.models.so_gaal import SO_GAAL
from pyod.models.mcd import MCD
from pyod.models.mo_gaal import MO_GAAL
from pyod.models.knn import KNN
from pyod.models.lof import LOF
from pyod.models.ocsvm import OCSVM

from pyod.models.feature_bagging import FeatureBagging
from pyod.models.sos import SOS

Class Code

tab_linear = pd.DataFrame(columns=["Accuracy","Precision","Recall","F1"])
tab_orbit = pd.DataFrame(columns=["Accuracy","Precision","Recall","F1"])
tab_bunny = pd.DataFrame(columns=["Accuracy","Precision","Recall","F1"])

class Conf_matrx:
    def __init__(self,original,compare,tab):
        self.original = original
        self.compare = compare
        self.tab = tab
    def conf(self,name):
        self.conf_matrix = confusion_matrix(self.original, self.compare)
        
        fig, ax = plt.subplots(figsize=(5, 5))
        ax.matshow(self.conf_matrix, cmap=plt.cm.Oranges, alpha=0.3)
        for i in range(self.conf_matrix.shape[0]):
            for j in range(self.conf_matrix.shape[1]):
                ax.text(x=j, y=i,s=self.conf_matrix[i, j], va='center', ha='center', size='xx-large')
        plt.xlabel('Predictions', fontsize=18)
        plt.ylabel('Actuals', fontsize=18)
        plt.title('Confusion Matrix', fontsize=18)
        plt.show()
        
        self.acc = accuracy_score(self.original, self.compare)
        self.pre = precision_score(self.original, self.compare)
        self.rec = recall_score(self.original, self.compare)
        self.f1 = f1_score(self.original, self.compare)
        
        print('Accuracy: %.3f' % self.acc)
        print('Precision: %.3f' % self.pre)
        print('Recall: %.3f' % self.rec)
        print('F1 Score: %.3f' % self.f1)
        
        self.tab = self.tab.append(pd.DataFrame({"Accuracy":[self.acc],"Precision":[self.pre],"Recall":[self.rec],"F1":[self.f1]},index = [name]))

class Linear:
    def __init__(self,df):
        self.df = df
        self.y = df.y.to_numpy()
        #self.y1 = df.y1.to_numpy()
        self.x = df.x.to_numpy()
        self.n = len(self.y)
        self.W = w
    def _eigen(self):
        d= self.W.sum(axis=1)
        D= np.diag(d)
        self.L = np.diag(1/np.sqrt(d)) @ (D-self.W) @ np.diag(1/np.sqrt(d))
        self.lamb, self.Psi = np.linalg.eigh(self.L)
        self.Lamb = np.diag(self.lamb)      
    def fit(self,sd=20): # fit with ebayesthresh
        self._eigen()
        self.ybar = self.Psi.T @ self.y # fbar := graph fourier transform of f
        self.power = self.ybar**2 
        ebayesthresh = importr('EbayesThresh').ebayesthresh
        self.power_threshed=np.array(ebayesthresh(FloatVector(self.ybar**2),sd=sd))
        self.ybar_threshed = np.where(self.power_threshed>0,self.ybar,0)
        self.yhat = self.Psi@self.ybar_threshed
        self.df = self.df.assign(yHat = self.yhat)
        self.df = self.df.assign(Residual = self.df.y- self.df.yHat)

class Orbit:
    def __init__(self,df):
        self.df = df 
        self.f = df.f.to_numpy()
        self.x = df.x.to_numpy()
        self.y = df.y.to_numpy()
        self.n = len(self.f)
        self.theta= None
    def get_distance(self):
        self.D = np.zeros([self.n,self.n])
        locations = np.stack([self.x, self.y],axis=1)
        for i in tqdm.tqdm(range(self.n)):
            for j in range(i,self.n):
                self.D[i,j]=np.linalg.norm(locations[i]-locations[j])
        self.D = self.D + self.D.T
    def get_weightmatrix(self,theta=1,beta=0.5,kappa=4000):
        self.theta = theta
        dist = np.where(self.D < kappa,self.D,0)
        self.W = np.exp(-(dist/self.theta)**2)
    def _eigen(self):
        d= self.W.sum(axis=1)
        D= np.diag(d)
        self.L = np.diag(1/np.sqrt(d)) @ (D-self.W) @ np.diag(1/np.sqrt(d))
        self.lamb, self.Psi = np.linalg.eigh(self.L)
        self.Lamb = np.diag(self.lamb)       
    def fit(self,sd=5,ref=20): # fit with ebayesthresh
        self._eigen()
        self.fbar = self.Psi.T @ self.f # fbar := graph fourier transform of f
        self.power = self.fbar**2 
        ebayesthresh = importr('EbayesThresh').ebayesthresh
        self.power_threshed=np.array(ebayesthresh(FloatVector(self.fbar**2),sd=sd))
        self.fbar_threshed = np.where(self.power_threshed>0,self.fbar,0)
        self.fhat = self.Psi@self.fbar_threshed
        self.df = self.df.assign(fHat = self.fhat)
        self.df = self.df.assign(Residual = self.df.f- self.df.fHat)
        self.bottom = np.zeros_like(self.f)
        self.width=0.05
        self.depth=0.05

class BUNNY:
    def __init__(self,df):
        self.df = df 
        self.f = df.f.to_numpy()
        self.z = df.z.to_numpy()
        self.x = df.x.to_numpy()
        self.y = df.y.to_numpy()
        self.noise = df.noise.to_numpy()
        self.fnoise = self.f + self.noise
        self.W = _W
        self.n = len(self.f)
        self.theta= None
    def _eigen(self):
        d= self.W.sum(axis=1)
        D= np.diag(d)
        self.L = np.diag(1/np.sqrt(d)) @ (D-self.W) @ np.diag(1/np.sqrt(d))
        self.lamb, self.Psi = np.linalg.eigh(self.L)
        self.Lamb = np.diag(self.lamb)       
    def fit(self,sd=5,ref=6): # fit with ebayesthresh
        self._eigen()
        self.fbar = self.Psi.T @ self.fnoise # fbar := graph fourier transform of f
        self.power = self.fbar**2 
        ebayesthresh = importr('EbayesThresh').ebayesthresh
        self.power_threshed=np.array(ebayesthresh(FloatVector(self.fbar**2),sd=sd))
        self.fbar_threshed = np.where(self.power_threshed>0,self.fbar,0)
        self.fhat = self.Psi@self.fbar_threshed
        self.df = self.df.assign(fnoise = self.fnoise)
        self.df = self.df.assign(fHat = self.fhat)
        self.df = self.df.assign(Residual = self.df.f + self.df.noise - self.df.fHat)
        self.bottom = np.zeros_like(self.f)
        self.width=0.05
        self.depth=0.05

Linear EbayesThresh

%load_ext rpy2.ipython

The rpy2.ipython extension is already loaded. To reload it, use:
  %reload_ext rpy2.ipython

%%R
library(EbayesThresh)
set.seed(1)
epsilon = rnorm(1000)
signal_1 = sample(c(runif(25,-2,-1.5), runif(25,1.5,2), rep(0,950)))
index_of_trueoutlier_1 = which(signal_1!=0)
index_of_trueoutlier_1
x_1=signal_1+epsilon

%R -o x_1
%R -o index_of_trueoutlier_1
%R -o signal_1

ebayesthresh = importr('EbayesThresh').ebayesthresh

outlier_true_index_1 = index_of_trueoutlier_1

outlier_true_value_1 = x_1[index_of_trueoutlier_1]

outlier_true_one_1 = signal_1.copy()

outlier_true_one_1 = list(map(lambda x: -1 if x!=0 else 1,outlier_true_one_1))

Linear

_x_1 = np.linspace(0,2,1000)
_y1_1 = 5*_x_1
_y_1 = _y1_1 + x_1 # x is epsilon

_df=pd.DataFrame({'x':_x_1, 'y':_y_1})

X = np.array(_df)

GODE

w=np.zeros((1000,1000))

for i in range(1000):
    for j in range(1000):
        if i==j :
            w[i,j] = 0
        elif np.abs(i-j) <= 1 : 
            w[i,j] = 1

_Linear = Linear(_df)

_Linear.fit(sd=5)

outlier_simul_one = (_Linear.df['Residual']**2).tolist()

outlier_simul_one = list(map(lambda x: -1 if x > 20 else 1,outlier_simul_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_simul_one,tab_linear)

_conf.conf("GODE")

Accuracy: 0.950
Precision: 0.950
Recall: 1.000
F1 Score: 0.974

one = _conf.tab

LOF

clf = LocalOutlierFactor(n_neighbors=2)

_conf = Conf_matrx(outlier_true_one_1,clf.fit_predict(X),tab_linear)

_conf.conf("LOF (Breunig et al., 2000)")

Accuracy: 0.890
Precision: 0.973
Recall: 0.909
F1 Score: 0.940

two = one.append(_conf.tab)

KNN

from pyod.models.knn import KNN

clf = KNN()
clf.fit(_df[['x', 'y']])
_df['knn_Clf'] = clf.labels_

outlier_KNN_one = list(clf.labels_)

outlier_KNN_one = list(map(lambda x: 1 if x==0  else -1,outlier_KNN_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_KNN_one,tab_linear)

_conf.conf("kNN (Ramaswamy et al., 2000)")

Accuracy: 0.912
Precision: 0.979
Recall: 0.927
F1 Score: 0.952

three = two.append(_conf.tab)

CBLOF

clf = CBLOF(contamination=0.05,check_estimator=False, random_state=77)
clf.fit(_df[['x', 'y']])
_df['CBLOF_Clf'] = clf.labels_

outlier_CBLOF_one = list(clf.labels_)

outlier_CBLOF_one = list(map(lambda x: 1 if x==0  else -1,outlier_CBLOF_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_CBLOF_one,tab_linear)

_conf.conf("CBLOF (He et al., 2003)")

Accuracy: 0.920
Precision: 0.958
Recall: 0.958
F1 Score: 0.958

four = three.append(_conf.tab)

OCSVM

clf = svm.OneClassSVM(nu=0.1, kernel="rbf", gamma=0.1)

clf.fit(X)

OneClassSVM(gamma=0.1, nu=0.1)

outlier_OSVM_one = list(clf.predict(X))

_conf = Conf_matrx(outlier_true_one_1,outlier_OSVM_one,tab_linear)

_conf.conf("OCSVM (Sch ̈olkopf et al., 2001)")

Accuracy: 0.909
Precision: 0.978
Recall: 0.925
F1 Score: 0.951

five = four.append(_conf.tab)

MCD

clf = MCD()
clf.fit(_df[['x', 'y']])
_df['MCD_clf'] = clf.labels_

outlier_MCD_one = list(clf.labels_)

outlier_MCD_one = list(map(lambda x: 1 if x==0  else -1,outlier_MCD_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_MCD_one,tab_linear)

_conf.conf("MCD (Hardin and Rocke, 2004)")

Accuracy: 0.918
Precision: 0.982
Recall: 0.931
F1 Score: 0.956

six = five.append(_conf.tab)

Feature Bagging

clf = FeatureBagging()
clf.fit(_df[['x', 'y']])
_df['FeatureBagging_clf'] = clf.labels_

outlier_FeatureBagging_one = list(clf.labels_)

outlier_FeatureBagging_one = list(map(lambda x: 1 if x==0  else -1,outlier_FeatureBagging_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_FeatureBagging_one,tab_linear)

_conf.conf("Feature Bagging (Lazarevic and Kumar, 2005)")

Accuracy: 0.918
Precision: 0.982
Recall: 0.931
F1 Score: 0.956

seven = six.append(_conf.tab)

ABOD

clf = ABOD(contamination=0.05)
clf.fit(_df[['x', 'y']])
_df['ABOD_Clf'] = clf.labels_

outlier_ABOD_one = list(clf.labels_)

outlier_ABOD_one = list(map(lambda x: 1 if x==0  else -1,outlier_ABOD_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_ABOD_one,tab_linear)

_conf.conf("ABOD (Kriegel et al., 2008)")

Accuracy: 0.946
Precision: 0.972
Recall: 0.972
F1 Score: 0.972

eight = seven.append(_conf.tab)

IForest

od = IForest(
    threshold=0.,
    n_estimators=100
)

od.fit(_df[['x', 'y']])

preds = od.predict(
    _df[['x', 'y']],
    return_instance_score=True
)

_df['IF_alibi'] = preds['data']['is_outlier']

outlier_alibi_one = _df['IF_alibi']

outlier_alibi_one = list(map(lambda x: 1 if x==0  else -1,outlier_alibi_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_alibi_one,tab_linear)

_conf.conf("Isolation Forest (Liu et al., 2008)")

Accuracy: 0.800
Precision: 0.984
Recall: 0.802
F1 Score: 0.884

nine = eight.append(_conf.tab)

HBOS

clf = HBOS()
clf.fit(_df[['x', 'y']])
_df['HBOS_clf'] = clf.labels_

outlier_HBOS_one = list(clf.labels_)

outlier_HBOS_one = list(map(lambda x: 1 if x==0  else -1,outlier_HBOS_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_HBOS_one,tab_linear)

_conf.conf("HBOS (Goldstein and Dengel, 2012)")

Accuracy: 0.889
Precision: 0.960
Recall: 0.921
F1 Score: 0.940

ten = nine.append(_conf.tab)

SOS

outlier_SOS_one = list(clf.labels_)

outlier_SOS_one = list(map(lambda x: 1 if x==0  else -1,outlier_SOS_one))

clf = SOS()
clf.fit(_df[['x', 'y']])
_df['SOS_clf'] = clf.labels_

_conf = Conf_matrx(outlier_true_one_1,outlier_SOS_one,tab_linear)

_conf.conf("SOS (Janssens et al., 2012)")

Accuracy: 0.889
Precision: 0.960
Recall: 0.921
F1 Score: 0.940

eleven = ten.append(_conf.tab)

SO_GAAL

clf = SO_GAAL()
clf.fit(_df[['x', 'y']])
_df['SO_GAAL_clf'] = clf.labels_

Epoch 1 of 60

Testing for epoch 1 index 1:

Testing for epoch 1 index 2:
Epoch 2 of 60

Testing for epoch 2 index 1:

Testing for epoch 2 index 2:
Epoch 3 of 60

Testing for epoch 3 index 1:

Testing for epoch 3 index 2:
Epoch 4 of 60

Testing for epoch 4 index 1:

Testing for epoch 4 index 2:
Epoch 5 of 60

Testing for epoch 5 index 1:

Testing for epoch 5 index 2:
Epoch 6 of 60

Testing for epoch 6 index 1:

Testing for epoch 6 index 2:
Epoch 7 of 60

Testing for epoch 7 index 1:

Testing for epoch 7 index 2:
Epoch 8 of 60

Testing for epoch 8 index 1:

Testing for epoch 8 index 2:
Epoch 9 of 60

Testing for epoch 9 index 1:

Testing for epoch 9 index 2:
Epoch 10 of 60

Testing for epoch 10 index 1:

Testing for epoch 10 index 2:
Epoch 11 of 60

Testing for epoch 11 index 1:

Testing for epoch 11 index 2:
Epoch 12 of 60

Testing for epoch 12 index 1:

Testing for epoch 12 index 2:
Epoch 13 of 60

Testing for epoch 13 index 1:

Testing for epoch 13 index 2:
Epoch 14 of 60

Testing for epoch 14 index 1:

Testing for epoch 14 index 2:
Epoch 15 of 60

Testing for epoch 15 index 1:

Testing for epoch 15 index 2:
Epoch 16 of 60

Testing for epoch 16 index 1:

Testing for epoch 16 index 2:
Epoch 17 of 60

Testing for epoch 17 index 1:

Testing for epoch 17 index 2:
Epoch 18 of 60

Testing for epoch 18 index 1:

Testing for epoch 18 index 2:
Epoch 19 of 60

Testing for epoch 19 index 1:

Testing for epoch 19 index 2:
Epoch 20 of 60

Testing for epoch 20 index 1:

Testing for epoch 20 index 2:
Epoch 21 of 60

Testing for epoch 21 index 1:

Testing for epoch 21 index 2:
Epoch 22 of 60

Testing for epoch 22 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.3973

Testing for epoch 22 index 2:
16/16 [==============================] - 0s 679us/step - loss: 1.4180
Epoch 23 of 60

Testing for epoch 23 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.4019

Testing for epoch 23 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.4210
Epoch 24 of 60

Testing for epoch 24 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.4234

Testing for epoch 24 index 2:
16/16 [==============================] - 0s 691us/step - loss: 1.4552
Epoch 25 of 60

Testing for epoch 25 index 1:
16/16 [==============================] - 0s 663us/step - loss: 1.4271

Testing for epoch 25 index 2:
16/16 [==============================] - 0s 767us/step - loss: 1.4613
Epoch 26 of 60

Testing for epoch 26 index 1:
16/16 [==============================] - 0s 602us/step - loss: 1.4776

Testing for epoch 26 index 2:
16/16 [==============================] - 0s 715us/step - loss: 1.4349
Epoch 27 of 60

Testing for epoch 27 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.4333

Testing for epoch 27 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.4840
Epoch 28 of 60

Testing for epoch 28 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.5092

Testing for epoch 28 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.4956
Epoch 29 of 60

Testing for epoch 29 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.5026

Testing for epoch 29 index 2:
16/16 [==============================] - 0s 831us/step - loss: 1.5576
Epoch 30 of 60

Testing for epoch 30 index 1:
16/16 [==============================] - 0s 611us/step - loss: 1.5602

Testing for epoch 30 index 2:
16/16 [==============================] - 0s 638us/step - loss: 1.4791
Epoch 31 of 60

Testing for epoch 31 index 1:
16/16 [==============================] - 0s 619us/step - loss: 1.5625

Testing for epoch 31 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.5635
Epoch 32 of 60

Testing for epoch 32 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.5925

Testing for epoch 32 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.5807
Epoch 33 of 60

Testing for epoch 33 index 1:
16/16 [==============================] - 0s 844us/step - loss: 1.5739

Testing for epoch 33 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.6122
Epoch 34 of 60

Testing for epoch 34 index 1:
16/16 [==============================] - 0s 657us/step - loss: 1.6156

Testing for epoch 34 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.6021
Epoch 35 of 60

Testing for epoch 35 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.6237

Testing for epoch 35 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.6302
Epoch 36 of 60

Testing for epoch 36 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.6586

Testing for epoch 36 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 1.6349
Epoch 37 of 60

Testing for epoch 37 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.6708

Testing for epoch 37 index 2:
16/16 [==============================] - 0s 726us/step - loss: 1.7010
Epoch 38 of 60

Testing for epoch 38 index 1:
16/16 [==============================] - 0s 826us/step - loss: 1.6865

Testing for epoch 38 index 2:
16/16 [==============================] - 0s 820us/step - loss: 1.6874
Epoch 39 of 60

Testing for epoch 39 index 1:
16/16 [==============================] - 0s 680us/step - loss: 1.7410

Testing for epoch 39 index 2:
16/16 [==============================] - 0s 663us/step - loss: 1.7334
Epoch 40 of 60

Testing for epoch 40 index 1:
16/16 [==============================] - 0s 637us/step - loss: 1.6871

Testing for epoch 40 index 2:
16/16 [==============================] - 0s 621us/step - loss: 1.7771
Epoch 41 of 60

Testing for epoch 41 index 1:
16/16 [==============================] - 0s 629us/step - loss: 1.7724

Testing for epoch 41 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.7815
Epoch 42 of 60

Testing for epoch 42 index 1:
16/16 [==============================] - 0s 647us/step - loss: 1.7470

Testing for epoch 42 index 2:
16/16 [==============================] - 0s 612us/step - loss: 1.7897
Epoch 43 of 60

Testing for epoch 43 index 1:
16/16 [==============================] - 0s 660us/step - loss: 1.8400

Testing for epoch 43 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8351
Epoch 44 of 60

Testing for epoch 44 index 1:
16/16 [==============================] - 0s 689us/step - loss: 1.8388

Testing for epoch 44 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8174
Epoch 45 of 60

Testing for epoch 45 index 1:
16/16 [==============================] - 0s 974us/step - loss: 1.8131

Testing for epoch 45 index 2:
16/16 [==============================] - 0s 712us/step - loss: 1.8391
Epoch 46 of 60

Testing for epoch 46 index 1:
16/16 [==============================] - 0s 635us/step - loss: 1.7937

Testing for epoch 46 index 2:
16/16 [==============================] - 0s 971us/step - loss: 1.8550
Epoch 47 of 60

Testing for epoch 47 index 1:
16/16 [==============================] - 0s 628us/step - loss: 1.8632

Testing for epoch 47 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8457
Epoch 48 of 60

Testing for epoch 48 index 1:
16/16 [==============================] - 0s 628us/step - loss: 1.8924

Testing for epoch 48 index 2:
16/16 [==============================] - 0s 640us/step - loss: 1.8481
Epoch 49 of 60

Testing for epoch 49 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.8722

Testing for epoch 49 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.9405
Epoch 50 of 60

Testing for epoch 50 index 1:
16/16 [==============================] - 0s 640us/step - loss: 1.9428

Testing for epoch 50 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8585
Epoch 51 of 60

Testing for epoch 51 index 1:
16/16 [==============================] - 0s 638us/step - loss: 1.8806

Testing for epoch 51 index 2:
16/16 [==============================] - 0s 608us/step - loss: 1.9145
Epoch 52 of 60

Testing for epoch 52 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.9380

Testing for epoch 52 index 2:
16/16 [==============================] - 0s 615us/step - loss: 1.8934
Epoch 53 of 60

Testing for epoch 53 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.9282

Testing for epoch 53 index 2:
16/16 [==============================] - 0s 651us/step - loss: 1.8956
Epoch 54 of 60

Testing for epoch 54 index 1:
16/16 [==============================] - 0s 630us/step - loss: 1.8997

Testing for epoch 54 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.9230
Epoch 55 of 60

Testing for epoch 55 index 1:
16/16 [==============================] - 0s 671us/step - loss: 1.9290

Testing for epoch 55 index 2:
16/16 [==============================] - 0s 885us/step - loss: 1.9631
Epoch 56 of 60

Testing for epoch 56 index 1:
16/16 [==============================] - 0s 643us/step - loss: 1.9394

Testing for epoch 56 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.9368
Epoch 57 of 60

Testing for epoch 57 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.9715

Testing for epoch 57 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.9327
Epoch 58 of 60

Testing for epoch 58 index 1:
16/16 [==============================] - 0s 690us/step - loss: 1.9782

Testing for epoch 58 index 2:
16/16 [==============================] - 0s 612us/step - loss: 1.9637
Epoch 59 of 60

Testing for epoch 59 index 1:
16/16 [==============================] - 0s 575us/step - loss: 1.9657

Testing for epoch 59 index 2:
16/16 [==============================] - 0s 890us/step - loss: 1.9923
Epoch 60 of 60

Testing for epoch 60 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.9824

Testing for epoch 60 index 2:
16/16 [==============================] - 0s 658us/step - loss: 2.0536

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/keras/optimizer_v2/gradient_descent.py:102: UserWarning: The `lr` argument is deprecated, use `learning_rate` instead.
  super(SGD, self).__init__(name, **kwargs)

outlier_SO_GAAL_one = list(clf.labels_)

outlier_SO_GAAL_one = list(map(lambda x: 1 if x==0  else -1,outlier_SO_GAAL_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_SO_GAAL_one,tab_linear)

_conf.conf("SO-GAAL (Liu et al., 2019)")

Accuracy: 0.868
Precision: 0.954
Recall: 0.904
F1 Score: 0.929

twelve = eleven.append(_conf.tab)

MO_GAAL

clf = MO_GAAL()
clf.fit(_df[['x', 'y']])
_df['MO_GAAL_clf'] = clf.labels_

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/keras/optimizer_v2/gradient_descent.py:102: UserWarning: The `lr` argument is deprecated, use `learning_rate` instead.
  super(SGD, self).__init__(name, **kwargs)

Epoch 1 of 60

Testing for epoch 1 index 1:

Testing for epoch 1 index 2:
Epoch 2 of 60

Testing for epoch 2 index 1:

Testing for epoch 2 index 2:
Epoch 3 of 60

Testing for epoch 3 index 1:

Testing for epoch 3 index 2:
Epoch 4 of 60

Testing for epoch 4 index 1:

Testing for epoch 4 index 2:
Epoch 5 of 60

Testing for epoch 5 index 1:

Testing for epoch 5 index 2:
Epoch 6 of 60

Testing for epoch 6 index 1:

Testing for epoch 6 index 2:
Epoch 7 of 60

Testing for epoch 7 index 1:

Testing for epoch 7 index 2:
Epoch 8 of 60

Testing for epoch 8 index 1:

Testing for epoch 8 index 2:
Epoch 9 of 60

Testing for epoch 9 index 1:

Testing for epoch 9 index 2:
Epoch 10 of 60

Testing for epoch 10 index 1:

Testing for epoch 10 index 2:
Epoch 11 of 60

Testing for epoch 11 index 1:

Testing for epoch 11 index 2:
Epoch 12 of 60

Testing for epoch 12 index 1:

Testing for epoch 12 index 2:
Epoch 13 of 60

Testing for epoch 13 index 1:

Testing for epoch 13 index 2:
Epoch 14 of 60

Testing for epoch 14 index 1:

Testing for epoch 14 index 2:
Epoch 15 of 60

Testing for epoch 15 index 1:

Testing for epoch 15 index 2:
Epoch 16 of 60

Testing for epoch 16 index 1:

Testing for epoch 16 index 2:
Epoch 17 of 60

Testing for epoch 17 index 1:

Testing for epoch 17 index 2:
Epoch 18 of 60

Testing for epoch 18 index 1:

Testing for epoch 18 index 2:
Epoch 19 of 60

Testing for epoch 19 index 1:

Testing for epoch 19 index 2:
Epoch 20 of 60

Testing for epoch 20 index 1:

Testing for epoch 20 index 2:
Epoch 21 of 60

Testing for epoch 21 index 1:

Testing for epoch 21 index 2:
16/16 [==============================] - 0s 674us/step - loss: 0.5119
16/16 [==============================] - 0s 1ms/step - loss: 0.8174
16/16 [==============================] - 0s 1ms/step - loss: 1.0584
16/16 [==============================] - 0s 1ms/step - loss: 1.2057
16/16 [==============================] - 0s 1ms/step - loss: 1.2512
16/16 [==============================] - 0s 653us/step - loss: 1.2690
16/16 [==============================] - 0s 640us/step - loss: 1.2744
16/16 [==============================] - 0s 846us/step - loss: 1.2761
16/16 [==============================] - 0s 782us/step - loss: 1.2766
16/16 [==============================] - 0s 1ms/step - loss: 1.2766
Epoch 22 of 60

Testing for epoch 22 index 1:
16/16 [==============================] - 0s 665us/step - loss: 0.5016
16/16 [==============================] - 0s 1ms/step - loss: 0.8168
16/16 [==============================] - 0s 729us/step - loss: 1.0701
16/16 [==============================] - 0s 619us/step - loss: 1.2239
16/16 [==============================] - 0s 952us/step - loss: 1.2703
16/16 [==============================] - 0s 680us/step - loss: 1.2884
16/16 [==============================] - 0s 1ms/step - loss: 1.2938
16/16 [==============================] - 0s 1ms/step - loss: 1.2955
16/16 [==============================] - 0s 674us/step - loss: 1.2959
16/16 [==============================] - 0s 680us/step - loss: 1.2959

Testing for epoch 22 index 2:
16/16 [==============================] - 0s 638us/step - loss: 0.4978
16/16 [==============================] - 0s 1ms/step - loss: 0.8174
16/16 [==============================] - 0s 988us/step - loss: 1.0777
16/16 [==============================] - 0s 683us/step - loss: 1.2388
16/16 [==============================] - 0s 1ms/step - loss: 1.2871
16/16 [==============================] - 0s 1ms/step - loss: 1.3063
16/16 [==============================] - 0s 899us/step - loss: 1.3121
16/16 [==============================] - 0s 701us/step - loss: 1.3140
16/16 [==============================] - 0s 674us/step - loss: 1.3144
16/16 [==============================] - 0s 894us/step - loss: 1.3144
Epoch 23 of 60

Testing for epoch 23 index 1:
16/16 [==============================] - 0s 629us/step - loss: 0.4856
16/16 [==============================] - 0s 911us/step - loss: 0.8190
16/16 [==============================] - 0s 1ms/step - loss: 1.0913
16/16 [==============================] - 0s 1ms/step - loss: 1.2605
16/16 [==============================] - 0s 1ms/step - loss: 1.3112
16/16 [==============================] - 0s 1ms/step - loss: 1.3310
16/16 [==============================] - 0s 2ms/step - loss: 1.3370
16/16 [==============================] - 0s 1ms/step - loss: 1.3389
16/16 [==============================] - 0s 745us/step - loss: 1.3393
16/16 [==============================] - 0s 964us/step - loss: 1.3393

Testing for epoch 23 index 2:
16/16 [==============================] - 0s 640us/step - loss: 0.4780
16/16 [==============================] - 0s 851us/step - loss: 0.8265
16/16 [==============================] - 0s 1ms/step - loss: 1.1094
16/16 [==============================] - 0s 1ms/step - loss: 1.2901
16/16 [==============================] - 0s 702us/step - loss: 1.3448
16/16 [==============================] - 0s 939us/step - loss: 1.3665
16/16 [==============================] - 0s 854us/step - loss: 1.3731
16/16 [==============================] - 0s 872us/step - loss: 1.3753
16/16 [==============================] - 0s 633us/step - loss: 1.3759
16/16 [==============================] - 0s 1ms/step - loss: 1.3759
Epoch 24 of 60

Testing for epoch 24 index 1:
16/16 [==============================] - 0s 709us/step - loss: 0.4680
16/16 [==============================] - 0s 964us/step - loss: 0.8342
16/16 [==============================] - 0s 717us/step - loss: 1.1328
16/16 [==============================] - 0s 631us/step - loss: 1.3245
16/16 [==============================] - 0s 1ms/step - loss: 1.3825
16/16 [==============================] - 0s 1ms/step - loss: 1.4056
16/16 [==============================] - 0s 1ms/step - loss: 1.4125
16/16 [==============================] - 0s 675us/step - loss: 1.4148
16/16 [==============================] - 0s 1ms/step - loss: 1.4154
16/16 [==============================] - 0s 1ms/step - loss: 1.4154

Testing for epoch 24 index 2:
16/16 [==============================] - 0s 683us/step - loss: 0.4700
16/16 [==============================] - 0s 1ms/step - loss: 0.8212
16/16 [==============================] - 0s 608us/step - loss: 1.1067
16/16 [==============================] - 0s 1ms/step - loss: 1.2919
16/16 [==============================] - 0s 645us/step - loss: 1.3484
16/16 [==============================] - 0s 655us/step - loss: 1.3713
16/16 [==============================] - 0s 1ms/step - loss: 1.3780
16/16 [==============================] - 0s 707us/step - loss: 1.3802
16/16 [==============================] - 0s 1ms/step - loss: 1.3807
16/16 [==============================] - 0s 1ms/step - loss: 1.3807
Epoch 25 of 60

Testing for epoch 25 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4568
16/16 [==============================] - 0s 1ms/step - loss: 0.8264
16/16 [==============================] - 0s 866us/step - loss: 1.1304
16/16 [==============================] - 0s 737us/step - loss: 1.3292
16/16 [==============================] - 0s 1ms/step - loss: 1.3891
16/16 [==============================] - 0s 859us/step - loss: 1.4139
16/16 [==============================] - 0s 664us/step - loss: 1.4209
16/16 [==============================] - 0s 1ms/step - loss: 1.4233
16/16 [==============================] - 0s 632us/step - loss: 1.4239
16/16 [==============================] - 0s 2ms/step - loss: 1.4239

Testing for epoch 25 index 2:
16/16 [==============================] - 0s 660us/step - loss: 0.4472
16/16 [==============================] - 0s 613us/step - loss: 0.8308
16/16 [==============================] - 0s 633us/step - loss: 1.1472
16/16 [==============================] - 0s 640us/step - loss: 1.3580
16/16 [==============================] - 0s 1ms/step - loss: 1.4212
16/16 [==============================] - 0s 644us/step - loss: 1.4477
16/16 [==============================] - 0s 621us/step - loss: 1.4553
16/16 [==============================] - 0s 601us/step - loss: 1.4579
16/16 [==============================] - 0s 799us/step - loss: 1.4585
16/16 [==============================] - 0s 663us/step - loss: 1.4585
Epoch 26 of 60

Testing for epoch 26 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4458
16/16 [==============================] - 0s 639us/step - loss: 0.8332
16/16 [==============================] - 0s 622us/step - loss: 1.1594
16/16 [==============================] - 0s 620us/step - loss: 1.3754
16/16 [==============================] - 0s 987us/step - loss: 1.4394
16/16 [==============================] - 0s 652us/step - loss: 1.4660
16/16 [==============================] - 0s 641us/step - loss: 1.4735
16/16 [==============================] - 0s 628us/step - loss: 1.4761
16/16 [==============================] - 0s 1ms/step - loss: 1.4766
16/16 [==============================] - 0s 597us/step - loss: 1.4766

Testing for epoch 26 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.4323
16/16 [==============================] - 0s 1ms/step - loss: 0.8289
16/16 [==============================] - 0s 1ms/step - loss: 1.1745
16/16 [==============================] - 0s 2ms/step - loss: 1.4047
16/16 [==============================] - 0s 1ms/step - loss: 1.4730
16/16 [==============================] - 0s 835us/step - loss: 1.5017
16/16 [==============================] - 0s 684us/step - loss: 1.5100
16/16 [==============================] - 0s 643us/step - loss: 1.5128
16/16 [==============================] - 0s 1ms/step - loss: 1.5135
16/16 [==============================] - 0s 1ms/step - loss: 1.5135
Epoch 27 of 60

Testing for epoch 27 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4311
16/16 [==============================] - 0s 693us/step - loss: 0.8327
16/16 [==============================] - 0s 639us/step - loss: 1.1867
16/16 [==============================] - 0s 606us/step - loss: 1.4217
16/16 [==============================] - 0s 816us/step - loss: 1.4904
16/16 [==============================] - 0s 828us/step - loss: 1.5189
16/16 [==============================] - 0s 1ms/step - loss: 1.5270
16/16 [==============================] - 0s 1ms/step - loss: 1.5298
16/16 [==============================] - 0s 1ms/step - loss: 1.5303
16/16 [==============================] - 0s 779us/step - loss: 1.5303

Testing for epoch 27 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.4224
16/16 [==============================] - 0s 1ms/step - loss: 0.8208
16/16 [==============================] - 0s 998us/step - loss: 1.1776
16/16 [==============================] - 0s 1ms/step - loss: 1.4157
16/16 [==============================] - 0s 635us/step - loss: 1.4850
16/16 [==============================] - 0s 1ms/step - loss: 1.5136
16/16 [==============================] - 0s 1ms/step - loss: 1.5217
16/16 [==============================] - 0s 640us/step - loss: 1.5245
16/16 [==============================] - 0s 590us/step - loss: 1.5251
16/16 [==============================] - 0s 1ms/step - loss: 1.5251
Epoch 28 of 60

Testing for epoch 28 index 1:
16/16 [==============================] - 0s 707us/step - loss: 0.4220
16/16 [==============================] - 0s 790us/step - loss: 0.8241
16/16 [==============================] - 0s 1ms/step - loss: 1.1871
16/16 [==============================] - 0s 829us/step - loss: 1.4277
16/16 [==============================] - 0s 796us/step - loss: 1.4965
16/16 [==============================] - 0s 1ms/step - loss: 1.5243
16/16 [==============================] - 0s 1ms/step - loss: 1.5321
16/16 [==============================] - 0s 1ms/step - loss: 1.5347
16/16 [==============================] - 0s 611us/step - loss: 1.5352
16/16 [==============================] - 0s 607us/step - loss: 1.5351

Testing for epoch 28 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.4162
16/16 [==============================] - 0s 765us/step - loss: 0.8240
16/16 [==============================] - 0s 1ms/step - loss: 1.1967
16/16 [==============================] - 0s 1ms/step - loss: 1.4447
16/16 [==============================] - 0s 1ms/step - loss: 1.5154
16/16 [==============================] - 0s 718us/step - loss: 1.5437
16/16 [==============================] - 0s 1ms/step - loss: 1.5517
16/16 [==============================] - 0s 1ms/step - loss: 1.5543
16/16 [==============================] - 0s 659us/step - loss: 1.5548
16/16 [==============================] - 0s 2ms/step - loss: 1.5547
Epoch 29 of 60

Testing for epoch 29 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4156
16/16 [==============================] - 0s 843us/step - loss: 0.8177
16/16 [==============================] - 0s 623us/step - loss: 1.1876
16/16 [==============================] - 0s 1ms/step - loss: 1.4313
16/16 [==============================] - 0s 1ms/step - loss: 1.4993
16/16 [==============================] - 0s 1ms/step - loss: 1.5259
16/16 [==============================] - 0s 723us/step - loss: 1.5332
16/16 [==============================] - 0s 640us/step - loss: 1.5355
16/16 [==============================] - 0s 625us/step - loss: 1.5358
16/16 [==============================] - 0s 634us/step - loss: 1.5357

Testing for epoch 29 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.4090
16/16 [==============================] - 0s 1ms/step - loss: 0.8233
16/16 [==============================] - 0s 1ms/step - loss: 1.2093
16/16 [==============================] - 0s 643us/step - loss: 1.4641
16/16 [==============================] - 0s 627us/step - loss: 1.5348
16/16 [==============================] - 0s 668us/step - loss: 1.5623
16/16 [==============================] - 0s 885us/step - loss: 1.5697
16/16 [==============================] - 0s 887us/step - loss: 1.5721
16/16 [==============================] - 0s 640us/step - loss: 1.5724
16/16 [==============================] - 0s 1ms/step - loss: 1.5724
Epoch 30 of 60

Testing for epoch 30 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4023
16/16 [==============================] - 0s 847us/step - loss: 0.8249
16/16 [==============================] - 0s 1ms/step - loss: 1.2211
16/16 [==============================] - 0s 669us/step - loss: 1.4795
16/16 [==============================] - 0s 837us/step - loss: 1.5497
16/16 [==============================] - 0s 1ms/step - loss: 1.5763
16/16 [==============================] - 0s 792us/step - loss: 1.5833
16/16 [==============================] - 0s 1ms/step - loss: 1.5854
16/16 [==============================] - 0s 821us/step - loss: 1.5856
16/16 [==============================] - 0s 654us/step - loss: 1.5855

Testing for epoch 30 index 2:
16/16 [==============================] - 0s 815us/step - loss: 0.4039
16/16 [==============================] - 0s 621us/step - loss: 0.8273
16/16 [==============================] - 0s 636us/step - loss: 1.2286
16/16 [==============================] - 0s 1ms/step - loss: 1.4900
16/16 [==============================] - 0s 1ms/step - loss: 1.5605
16/16 [==============================] - 0s 1ms/step - loss: 1.5869
16/16 [==============================] - 0s 1ms/step - loss: 1.5938
16/16 [==============================] - 0s 2ms/step - loss: 1.5958
16/16 [==============================] - 0s 1ms/step - loss: 1.5960
16/16 [==============================] - 0s 721us/step - loss: 1.5958
Epoch 31 of 60

Testing for epoch 31 index 1:
16/16 [==============================] - 0s 822us/step - loss: 0.3922
16/16 [==============================] - 0s 618us/step - loss: 0.8303
16/16 [==============================] - 0s 979us/step - loss: 1.2484
16/16 [==============================] - 0s 594us/step - loss: 1.5177
16/16 [==============================] - 0s 584us/step - loss: 1.5887
16/16 [==============================] - 0s 886us/step - loss: 1.6148
16/16 [==============================] - 0s 616us/step - loss: 1.6214
16/16 [==============================] - 0s 986us/step - loss: 1.6232
16/16 [==============================] - 0s 634us/step - loss: 1.6234
16/16 [==============================] - 0s 647us/step - loss: 1.6232

Testing for epoch 31 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3917
16/16 [==============================] - 0s 638us/step - loss: 0.8412
16/16 [==============================] - 0s 1ms/step - loss: 1.2745
16/16 [==============================] - 0s 1ms/step - loss: 1.5525
16/16 [==============================] - 0s 597us/step - loss: 1.6251
16/16 [==============================] - 0s 1ms/step - loss: 1.6514
16/16 [==============================] - 0s 1ms/step - loss: 1.6580
16/16 [==============================] - 0s 1ms/step - loss: 1.6598
16/16 [==============================] - 0s 1ms/step - loss: 1.6598
16/16 [==============================] - 0s 875us/step - loss: 1.6597
Epoch 32 of 60

Testing for epoch 32 index 1:
16/16 [==============================] - 0s 643us/step - loss: 0.3861
16/16 [==============================] - 0s 1ms/step - loss: 0.8410
16/16 [==============================] - 0s 1ms/step - loss: 1.2819
16/16 [==============================] - 0s 747us/step - loss: 1.5604
16/16 [==============================] - 0s 1ms/step - loss: 1.6314
16/16 [==============================] - 0s 2ms/step - loss: 1.6566
16/16 [==============================] - 0s 1ms/step - loss: 1.6625
16/16 [==============================] - 0s 1ms/step - loss: 1.6641
16/16 [==============================] - 0s 682us/step - loss: 1.6641
16/16 [==============================] - 0s 868us/step - loss: 1.6639

Testing for epoch 32 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3785
16/16 [==============================] - 0s 640us/step - loss: 0.8366
16/16 [==============================] - 0s 620us/step - loss: 1.2831
16/16 [==============================] - 0s 630us/step - loss: 1.5628
16/16 [==============================] - 0s 569us/step - loss: 1.6327
16/16 [==============================] - 0s 1ms/step - loss: 1.6570
16/16 [==============================] - 0s 1ms/step - loss: 1.6626
16/16 [==============================] - 0s 671us/step - loss: 1.6639
16/16 [==============================] - 0s 1ms/step - loss: 1.6638
16/16 [==============================] - 0s 1ms/step - loss: 1.6636
Epoch 33 of 60

Testing for epoch 33 index 1:
16/16 [==============================] - 0s 686us/step - loss: 0.3794
16/16 [==============================] - 0s 1ms/step - loss: 0.8368
16/16 [==============================] - 0s 590us/step - loss: 1.2836
16/16 [==============================] - 0s 1ms/step - loss: 1.5578
16/16 [==============================] - 0s 1ms/step - loss: 1.6242
16/16 [==============================] - 0s 1ms/step - loss: 1.6467
16/16 [==============================] - 0s 1ms/step - loss: 1.6516
16/16 [==============================] - 0s 880us/step - loss: 1.6526
16/16 [==============================] - 0s 1ms/step - loss: 1.6524
16/16 [==============================] - 0s 744us/step - loss: 1.6521

Testing for epoch 33 index 2:
16/16 [==============================] - 0s 639us/step - loss: 0.3767
16/16 [==============================] - 0s 675us/step - loss: 0.8386
16/16 [==============================] - 0s 636us/step - loss: 1.2925
16/16 [==============================] - 0s 667us/step - loss: 1.5686
16/16 [==============================] - 0s 570us/step - loss: 1.6342
16/16 [==============================] - 0s 650us/step - loss: 1.6560
16/16 [==============================] - 0s 1ms/step - loss: 1.6605
16/16 [==============================] - 0s 1ms/step - loss: 1.6614
16/16 [==============================] - 0s 828us/step - loss: 1.6611
16/16 [==============================] - 0s 754us/step - loss: 1.6608
Epoch 34 of 60

Testing for epoch 34 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.3785
16/16 [==============================] - 0s 606us/step - loss: 0.8568
16/16 [==============================] - 0s 1ms/step - loss: 1.3267
16/16 [==============================] - 0s 1ms/step - loss: 1.6075
16/16 [==============================] - 0s 632us/step - loss: 1.6723
16/16 [==============================] - 0s 700us/step - loss: 1.6932
16/16 [==============================] - 0s 814us/step - loss: 1.6974
16/16 [==============================] - 0s 1ms/step - loss: 1.6980
16/16 [==============================] - 0s 2ms/step - loss: 1.6977
16/16 [==============================] - 0s 1ms/step - loss: 1.6974

Testing for epoch 34 index 2:
16/16 [==============================] - 0s 611us/step - loss: 0.3640
16/16 [==============================] - 0s 586us/step - loss: 0.8516
16/16 [==============================] - 0s 613us/step - loss: 1.3334
16/16 [==============================] - 0s 631us/step - loss: 1.6188
16/16 [==============================] - 0s 635us/step - loss: 1.6834
16/16 [==============================] - 0s 1ms/step - loss: 1.7039
16/16 [==============================] - 0s 600us/step - loss: 1.7078
16/16 [==============================] - 0s 784us/step - loss: 1.7083
16/16 [==============================] - 0s 1ms/step - loss: 1.7080
16/16 [==============================] - 0s 654us/step - loss: 1.7076
Epoch 35 of 60

Testing for epoch 35 index 1:
16/16 [==============================] - 0s 642us/step - loss: 0.3623
16/16 [==============================] - 0s 870us/step - loss: 0.8627
16/16 [==============================] - 0s 1ms/step - loss: 1.3550
16/16 [==============================] - 0s 935us/step - loss: 1.6411
16/16 [==============================] - 0s 631us/step - loss: 1.7039
16/16 [==============================] - 0s 1ms/step - loss: 1.7231
16/16 [==============================] - 0s 659us/step - loss: 1.7264
16/16 [==============================] - 0s 1ms/step - loss: 1.7267
16/16 [==============================] - 0s 1ms/step - loss: 1.7262
16/16 [==============================] - 0s 706us/step - loss: 1.7259

Testing for epoch 35 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3604
16/16 [==============================] - 0s 635us/step - loss: 0.8668
16/16 [==============================] - 0s 889us/step - loss: 1.3676
16/16 [==============================] - 0s 1ms/step - loss: 1.6572
16/16 [==============================] - 0s 947us/step - loss: 1.7200
16/16 [==============================] - 0s 2ms/step - loss: 1.7389
16/16 [==============================] - 0s 772us/step - loss: 1.7421
16/16 [==============================] - 0s 1ms/step - loss: 1.7424
16/16 [==============================] - 0s 1ms/step - loss: 1.7419
16/16 [==============================] - 0s 744us/step - loss: 1.7415
Epoch 36 of 60

Testing for epoch 36 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.3571
16/16 [==============================] - 0s 680us/step - loss: 0.8755
16/16 [==============================] - 0s 751us/step - loss: 1.3899
16/16 [==============================] - 0s 1ms/step - loss: 1.6814
16/16 [==============================] - 0s 1ms/step - loss: 1.7429
16/16 [==============================] - 0s 1ms/step - loss: 1.7609
16/16 [==============================] - 0s 681us/step - loss: 1.7637
16/16 [==============================] - 0s 677us/step - loss: 1.7638
16/16 [==============================] - 0s 646us/step - loss: 1.7633
16/16 [==============================] - 0s 1ms/step - loss: 1.7629

Testing for epoch 36 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3680
16/16 [==============================] - 0s 623us/step - loss: 0.8560
16/16 [==============================] - 0s 652us/step - loss: 1.3413
16/16 [==============================] - 0s 605us/step - loss: 1.6123
16/16 [==============================] - 0s 622us/step - loss: 1.6680
16/16 [==============================] - 0s 808us/step - loss: 1.6837
16/16 [==============================] - 0s 1ms/step - loss: 1.6859
16/16 [==============================] - 0s 889us/step - loss: 1.6858
16/16 [==============================] - 0s 633us/step - loss: 1.6852
16/16 [==============================] - 0s 626us/step - loss: 1.6848
Epoch 37 of 60

Testing for epoch 37 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.3582
16/16 [==============================] - 0s 660us/step - loss: 0.8667
16/16 [==============================] - 0s 649us/step - loss: 1.3768
16/16 [==============================] - 0s 1000us/step - loss: 1.6562
16/16 [==============================] - 0s 1ms/step - loss: 1.7123
16/16 [==============================] - 0s 634us/step - loss: 1.7277
16/16 [==============================] - 0s 685us/step - loss: 1.7297
16/16 [==============================] - 0s 1ms/step - loss: 1.7295
16/16 [==============================] - 0s 1ms/step - loss: 1.7288
16/16 [==============================] - 0s 628us/step - loss: 1.7284

Testing for epoch 37 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3583
16/16 [==============================] - 0s 1ms/step - loss: 0.8671
16/16 [==============================] - 0s 1ms/step - loss: 1.3803
16/16 [==============================] - 0s 1ms/step - loss: 1.6596
16/16 [==============================] - 0s 1ms/step - loss: 1.7150
16/16 [==============================] - 0s 692us/step - loss: 1.7298
16/16 [==============================] - 0s 979us/step - loss: 1.7317
16/16 [==============================] - 0s 1ms/step - loss: 1.7314
16/16 [==============================] - 0s 1ms/step - loss: 1.7308
16/16 [==============================] - 0s 1ms/step - loss: 1.7304
Epoch 38 of 60

Testing for epoch 38 index 1:
16/16 [==============================] - 0s 863us/step - loss: 0.3471
16/16 [==============================] - 0s 661us/step - loss: 0.8780
16/16 [==============================] - 0s 659us/step - loss: 1.4219
16/16 [==============================] - 0s 1ms/step - loss: 1.7117
16/16 [==============================] - 0s 1ms/step - loss: 1.7680
16/16 [==============================] - 0s 1ms/step - loss: 1.7827
16/16 [==============================] - 0s 824us/step - loss: 1.7845
16/16 [==============================] - 0s 1ms/step - loss: 1.7841
16/16 [==============================] - 0s 1ms/step - loss: 1.7834
16/16 [==============================] - 0s 2ms/step - loss: 1.7830

Testing for epoch 38 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3466
16/16 [==============================] - 0s 680us/step - loss: 0.8801
16/16 [==============================] - 0s 1ms/step - loss: 1.4285
16/16 [==============================] - 0s 615us/step - loss: 1.7186
16/16 [==============================] - 0s 1ms/step - loss: 1.7739
16/16 [==============================] - 0s 1ms/step - loss: 1.7880
16/16 [==============================] - 0s 1ms/step - loss: 1.7895
16/16 [==============================] - 0s 619us/step - loss: 1.7890
16/16 [==============================] - 0s 1ms/step - loss: 1.7882
16/16 [==============================] - 0s 587us/step - loss: 1.7878
Epoch 39 of 60

Testing for epoch 39 index 1:
16/16 [==============================] - 0s 861us/step - loss: 0.3492
16/16 [==============================] - 0s 879us/step - loss: 0.8719
16/16 [==============================] - 0s 664us/step - loss: 1.4147
16/16 [==============================] - 0s 643us/step - loss: 1.6946
16/16 [==============================] - 0s 1ms/step - loss: 1.7465
16/16 [==============================] - 0s 621us/step - loss: 1.7591
16/16 [==============================] - 0s 594us/step - loss: 1.7602
16/16 [==============================] - 0s 612us/step - loss: 1.7596
16/16 [==============================] - 0s 594us/step - loss: 1.7588
16/16 [==============================] - 0s 660us/step - loss: 1.7584

Testing for epoch 39 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3448
16/16 [==============================] - 0s 891us/step - loss: 0.8840
16/16 [==============================] - 0s 1ms/step - loss: 1.4475
16/16 [==============================] - 0s 634us/step - loss: 1.7374
16/16 [==============================] - 0s 1ms/step - loss: 1.7907
16/16 [==============================] - 0s 1ms/step - loss: 1.8035
16/16 [==============================] - 0s 698us/step - loss: 1.8046
16/16 [==============================] - 0s 660us/step - loss: 1.8040
16/16 [==============================] - 0s 828us/step - loss: 1.8032
16/16 [==============================] - 0s 1ms/step - loss: 1.8028
Epoch 40 of 60

Testing for epoch 40 index 1:
16/16 [==============================] - 0s 604us/step - loss: 0.3427
16/16 [==============================] - 0s 629us/step - loss: 0.8792
16/16 [==============================] - 0s 613us/step - loss: 1.4449
16/16 [==============================] - 0s 605us/step - loss: 1.7294
16/16 [==============================] - 0s 1ms/step - loss: 1.7803
16/16 [==============================] - 0s 1ms/step - loss: 1.7920
16/16 [==============================] - 0s 670us/step - loss: 1.7928
16/16 [==============================] - 0s 1ms/step - loss: 1.7921
16/16 [==============================] - 0s 702us/step - loss: 1.7912
16/16 [==============================] - 0s 978us/step - loss: 1.7908

Testing for epoch 40 index 2:
16/16 [==============================] - 0s 884us/step - loss: 0.3356
16/16 [==============================] - 0s 1ms/step - loss: 0.8885
16/16 [==============================] - 0s 850us/step - loss: 1.4743
16/16 [==============================] - 0s 730us/step - loss: 1.7694
16/16 [==============================] - 0s 1ms/step - loss: 1.8221
16/16 [==============================] - 0s 944us/step - loss: 1.8343
16/16 [==============================] - 0s 932us/step - loss: 1.8352
16/16 [==============================] - 0s 696us/step - loss: 1.8345
16/16 [==============================] - 0s 1ms/step - loss: 1.8337
16/16 [==============================] - 0s 1ms/step - loss: 1.8333
Epoch 41 of 60

Testing for epoch 41 index 1:
16/16 [==============================] - 0s 612us/step - loss: 0.3393
16/16 [==============================] - 0s 595us/step - loss: 0.8775
16/16 [==============================] - 0s 1ms/step - loss: 1.4502
16/16 [==============================] - 0s 1ms/step - loss: 1.7321
16/16 [==============================] - 0s 1ms/step - loss: 1.7808
16/16 [==============================] - 0s 1ms/step - loss: 1.7913
16/16 [==============================] - 0s 1ms/step - loss: 1.7917
16/16 [==============================] - 0s 663us/step - loss: 1.7909
16/16 [==============================] - 0s 688us/step - loss: 1.7900
16/16 [==============================] - 0s 659us/step - loss: 1.7895

Testing for epoch 41 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3349
16/16 [==============================] - 0s 913us/step - loss: 0.8782
16/16 [==============================] - 0s 683us/step - loss: 1.4573
16/16 [==============================] - 0s 2ms/step - loss: 1.7431
16/16 [==============================] - 0s 1ms/step - loss: 1.7923
16/16 [==============================] - 0s 1ms/step - loss: 1.8028
16/16 [==============================] - 0s 647us/step - loss: 1.8033
16/16 [==============================] - 0s 633us/step - loss: 1.8024
16/16 [==============================] - 0s 573us/step - loss: 1.8015
16/16 [==============================] - 0s 2ms/step - loss: 1.8011
Epoch 42 of 60

Testing for epoch 42 index 1:
16/16 [==============================] - 0s 712us/step - loss: 0.3296
16/16 [==============================] - 0s 757us/step - loss: 0.8910
16/16 [==============================] - 0s 1ms/step - loss: 1.4933
16/16 [==============================] - 0s 676us/step - loss: 1.7869
16/16 [==============================] - 0s 639us/step - loss: 1.8366
16/16 [==============================] - 0s 622us/step - loss: 1.8470
16/16 [==============================] - 0s 605us/step - loss: 1.8474
16/16 [==============================] - 0s 1ms/step - loss: 1.8464
16/16 [==============================] - 0s 1ms/step - loss: 1.8456
16/16 [==============================] - 0s 1ms/step - loss: 1.8451

Testing for epoch 42 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3304
16/16 [==============================] - 0s 1ms/step - loss: 0.8862
16/16 [==============================] - 0s 704us/step - loss: 1.4818
16/16 [==============================] - 0s 1ms/step - loss: 1.7733
16/16 [==============================] - 0s 679us/step - loss: 1.8222
16/16 [==============================] - 0s 644us/step - loss: 1.8324
16/16 [==============================] - 0s 1ms/step - loss: 1.8327
16/16 [==============================] - 0s 1ms/step - loss: 1.8318
16/16 [==============================] - 0s 653us/step - loss: 1.8309
16/16 [==============================] - 0s 1ms/step - loss: 1.8304
Epoch 43 of 60

Testing for epoch 43 index 1:
16/16 [==============================] - 0s 769us/step - loss: 0.3289
16/16 [==============================] - 0s 1ms/step - loss: 0.8923
16/16 [==============================] - 0s 889us/step - loss: 1.4981
16/16 [==============================] - 0s 676us/step - loss: 1.7912
16/16 [==============================] - 0s 576us/step - loss: 1.8395
16/16 [==============================] - 0s 594us/step - loss: 1.8492
16/16 [==============================] - 0s 614us/step - loss: 1.8493
16/16 [==============================] - 0s 754us/step - loss: 1.8483
16/16 [==============================] - 0s 1ms/step - loss: 1.8474
16/16 [==============================] - 0s 620us/step - loss: 1.8469

Testing for epoch 43 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3236
16/16 [==============================] - 0s 669us/step - loss: 0.8897
16/16 [==============================] - 0s 1ms/step - loss: 1.4962
16/16 [==============================] - 0s 622us/step - loss: 1.7918
16/16 [==============================] - 0s 636us/step - loss: 1.8402
16/16 [==============================] - 0s 609us/step - loss: 1.8499
16/16 [==============================] - 0s 589us/step - loss: 1.8499
16/16 [==============================] - 0s 1ms/step - loss: 1.8488
16/16 [==============================] - 0s 1ms/step - loss: 1.8479
16/16 [==============================] - 0s 1ms/step - loss: 1.8474
Epoch 44 of 60

Testing for epoch 44 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.3240
16/16 [==============================] - 0s 1ms/step - loss: 0.9065
16/16 [==============================] - 0s 1ms/step - loss: 1.5340
16/16 [==============================] - 0s 699us/step - loss: 1.8380
16/16 [==============================] - 0s 644us/step - loss: 1.8875
16/16 [==============================] - 0s 603us/step - loss: 1.8973
16/16 [==============================] - 0s 1ms/step - loss: 1.8974
16/16 [==============================] - 0s 1ms/step - loss: 1.8964
16/16 [==============================] - 0s 1ms/step - loss: 1.8954
16/16 [==============================] - 0s 773us/step - loss: 1.8950

Testing for epoch 44 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3120
16/16 [==============================] - 0s 980us/step - loss: 0.9140
16/16 [==============================] - 0s 1ms/step - loss: 1.5655
16/16 [==============================] - 0s 1ms/step - loss: 1.8840
16/16 [==============================] - 0s 1ms/step - loss: 1.9360
16/16 [==============================] - 0s 677us/step - loss: 1.9465
16/16 [==============================] - 0s 1ms/step - loss: 1.9468
16/16 [==============================] - 0s 736us/step - loss: 1.9458
16/16 [==============================] - 0s 645us/step - loss: 1.9449
16/16 [==============================] - 0s 648us/step - loss: 1.9444
Epoch 45 of 60

Testing for epoch 45 index 1:
16/16 [==============================] - 0s 673us/step - loss: 0.3280
16/16 [==============================] - 0s 651us/step - loss: 0.8989
16/16 [==============================] - 0s 1ms/step - loss: 1.5171
16/16 [==============================] - 0s 626us/step - loss: 1.8154
16/16 [==============================] - 0s 1ms/step - loss: 1.8629
16/16 [==============================] - 0s 629us/step - loss: 1.8720
16/16 [==============================] - 0s 1ms/step - loss: 1.8720
16/16 [==============================] - 0s 1ms/step - loss: 1.8709
16/16 [==============================] - 0s 1ms/step - loss: 1.8700
16/16 [==============================] - 0s 632us/step - loss: 1.8696

Testing for epoch 45 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3253
16/16 [==============================] - 0s 816us/step - loss: 0.8820
16/16 [==============================] - 0s 782us/step - loss: 1.4859
16/16 [==============================] - 0s 1ms/step - loss: 1.7760
16/16 [==============================] - 0s 1ms/step - loss: 1.8211
16/16 [==============================] - 0s 672us/step - loss: 1.8292
16/16 [==============================] - 0s 2ms/step - loss: 1.8287
16/16 [==============================] - 0s 1ms/step - loss: 1.8275
16/16 [==============================] - 0s 2ms/step - loss: 1.8265
16/16 [==============================] - 0s 705us/step - loss: 1.8259
Epoch 46 of 60

Testing for epoch 46 index 1:
16/16 [==============================] - 0s 629us/step - loss: 0.3018
16/16 [==============================] - 0s 609us/step - loss: 0.9113
16/16 [==============================] - 0s 1ms/step - loss: 1.5796
16/16 [==============================] - 0s 1ms/step - loss: 1.8997
16/16 [==============================] - 0s 1ms/step - loss: 1.9496
16/16 [==============================] - 0s 657us/step - loss: 1.9589
16/16 [==============================] - 0s 591us/step - loss: 1.9587
16/16 [==============================] - 0s 1ms/step - loss: 1.9575
16/16 [==============================] - 0s 2ms/step - loss: 1.9565
16/16 [==============================] - 0s 893us/step - loss: 1.9560

Testing for epoch 46 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.3160
16/16 [==============================] - 0s 649us/step - loss: 0.8929
16/16 [==============================] - 0s 663us/step - loss: 1.5280
16/16 [==============================] - 0s 668us/step - loss: 1.8325
16/16 [==============================] - 0s 1ms/step - loss: 1.8797
16/16 [==============================] - 0s 698us/step - loss: 1.8884
16/16 [==============================] - 0s 700us/step - loss: 1.8881
16/16 [==============================] - 0s 631us/step - loss: 1.8869
16/16 [==============================] - 0s 1ms/step - loss: 1.8859
16/16 [==============================] - 0s 649us/step - loss: 1.8854
Epoch 47 of 60

Testing for epoch 47 index 1:
16/16 [==============================] - 0s 684us/step - loss: 0.3158
16/16 [==============================] - 0s 627us/step - loss: 0.9064
16/16 [==============================] - 0s 1ms/step - loss: 1.5588
16/16 [==============================] - 0s 632us/step - loss: 1.8678
16/16 [==============================] - 0s 618us/step - loss: 1.9149
16/16 [==============================] - 0s 585us/step - loss: 1.9232
16/16 [==============================] - 0s 1ms/step - loss: 1.9228
16/16 [==============================] - 0s 1ms/step - loss: 1.9215
16/16 [==============================] - 0s 1ms/step - loss: 1.9205
16/16 [==============================] - 0s 694us/step - loss: 1.9200

Testing for epoch 47 index 2:
16/16 [==============================] - 0s 695us/step - loss: 0.3114
16/16 [==============================] - 0s 805us/step - loss: 0.8972
16/16 [==============================] - 0s 899us/step - loss: 1.5487
16/16 [==============================] - 0s 1ms/step - loss: 1.8577
16/16 [==============================] - 0s 705us/step - loss: 1.9042
16/16 [==============================] - 0s 597us/step - loss: 1.9123
16/16 [==============================] - 0s 630us/step - loss: 1.9118
16/16 [==============================] - 0s 706us/step - loss: 1.9105
16/16 [==============================] - 0s 1ms/step - loss: 1.9094
16/16 [==============================] - 0s 790us/step - loss: 1.9089
Epoch 48 of 60

Testing for epoch 48 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.3079
16/16 [==============================] - 0s 1ms/step - loss: 0.9138
16/16 [==============================] - 0s 610us/step - loss: 1.5910
16/16 [==============================] - 0s 1ms/step - loss: 1.9092
16/16 [==============================] - 0s 680us/step - loss: 1.9566
16/16 [==============================] - 0s 609us/step - loss: 1.9647
16/16 [==============================] - 0s 617us/step - loss: 1.9641
16/16 [==============================] - 0s 620us/step - loss: 1.9628
16/16 [==============================] - 0s 621us/step - loss: 1.9617
16/16 [==============================] - 0s 639us/step - loss: 1.9612

Testing for epoch 48 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2996
16/16 [==============================] - 0s 668us/step - loss: 0.9044
16/16 [==============================] - 0s 1ms/step - loss: 1.5879
16/16 [==============================] - 0s 1ms/step - loss: 1.9109
16/16 [==============================] - 0s 1ms/step - loss: 1.9594
16/16 [==============================] - 0s 1ms/step - loss: 1.9680
16/16 [==============================] - 0s 677us/step - loss: 1.9676
16/16 [==============================] - 0s 640us/step - loss: 1.9664
16/16 [==============================] - 0s 630us/step - loss: 1.9654
16/16 [==============================] - 0s 612us/step - loss: 1.9649
Epoch 49 of 60

Testing for epoch 49 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.3126
16/16 [==============================] - 0s 1ms/step - loss: 0.8881
16/16 [==============================] - 0s 985us/step - loss: 1.5372
16/16 [==============================] - 0s 2ms/step - loss: 1.8393
16/16 [==============================] - 0s 621us/step - loss: 1.8833
16/16 [==============================] - 0s 753us/step - loss: 1.8904
16/16 [==============================] - 0s 1ms/step - loss: 1.8896
16/16 [==============================] - 0s 602us/step - loss: 1.8883
16/16 [==============================] - 0s 689us/step - loss: 1.8872
16/16 [==============================] - 0s 1ms/step - loss: 1.8867

Testing for epoch 49 index 2:
16/16 [==============================] - 0s 658us/step - loss: 0.3055
16/16 [==============================] - 0s 641us/step - loss: 0.8975
16/16 [==============================] - 0s 577us/step - loss: 1.5715
16/16 [==============================] - 0s 612us/step - loss: 1.8861
16/16 [==============================] - 0s 605us/step - loss: 1.9320
16/16 [==============================] - 0s 997us/step - loss: 1.9395
16/16 [==============================] - 0s 1ms/step - loss: 1.9388
16/16 [==============================] - 0s 644us/step - loss: 1.9374
16/16 [==============================] - 0s 952us/step - loss: 1.9364
16/16 [==============================] - 0s 628us/step - loss: 1.9358
Epoch 50 of 60

Testing for epoch 50 index 1:
16/16 [==============================] - 0s 796us/step - loss: 0.2940
16/16 [==============================] - 0s 649us/step - loss: 0.9002
16/16 [==============================] - 0s 1ms/step - loss: 1.5930
16/16 [==============================] - 0s 964us/step - loss: 1.9135
16/16 [==============================] - 0s 1ms/step - loss: 1.9596
16/16 [==============================] - 0s 674us/step - loss: 1.9670
16/16 [==============================] - 0s 652us/step - loss: 1.9662
16/16 [==============================] - 0s 642us/step - loss: 1.9648
16/16 [==============================] - 0s 1ms/step - loss: 1.9638
16/16 [==============================] - 0s 1ms/step - loss: 1.9633

Testing for epoch 50 index 2:
16/16 [==============================] - 0s 665us/step - loss: 0.3044
16/16 [==============================] - 0s 665us/step - loss: 0.9019
16/16 [==============================] - 0s 1ms/step - loss: 1.5888
16/16 [==============================] - 0s 665us/step - loss: 1.9064
16/16 [==============================] - 0s 1ms/step - loss: 1.9517
16/16 [==============================] - 0s 660us/step - loss: 1.9588
16/16 [==============================] - 0s 691us/step - loss: 1.9579
16/16 [==============================] - 0s 1ms/step - loss: 1.9565
16/16 [==============================] - 0s 1ms/step - loss: 1.9554
16/16 [==============================] - 0s 693us/step - loss: 1.9549
Epoch 51 of 60

Testing for epoch 51 index 1:
16/16 [==============================] - 0s 939us/step - loss: 0.3020
16/16 [==============================] - 0s 739us/step - loss: 0.8987
16/16 [==============================] - 0s 698us/step - loss: 1.5860
16/16 [==============================] - 0s 1ms/step - loss: 1.9003
16/16 [==============================] - 0s 652us/step - loss: 1.9445
16/16 [==============================] - 0s 807us/step - loss: 1.9511
16/16 [==============================] - 0s 1ms/step - loss: 1.9502
16/16 [==============================] - 0s 1ms/step - loss: 1.9488
16/16 [==============================] - 0s 669us/step - loss: 1.9477
16/16 [==============================] - 0s 642us/step - loss: 1.9472

Testing for epoch 51 index 2:
16/16 [==============================] - 0s 919us/step - loss: 0.2888
16/16 [==============================] - 0s 799us/step - loss: 0.9191
16/16 [==============================] - 0s 639us/step - loss: 1.6532
16/16 [==============================] - 0s 1ms/step - loss: 1.9907
16/16 [==============================] - 0s 617us/step - loss: 2.0383
16/16 [==============================] - 0s 1000us/step - loss: 2.0458
16/16 [==============================] - 0s 1ms/step - loss: 2.0449
16/16 [==============================] - 0s 617us/step - loss: 2.0435
16/16 [==============================] - 0s 1ms/step - loss: 2.0424
16/16 [==============================] - 0s 617us/step - loss: 2.0419
Epoch 52 of 60

Testing for epoch 52 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2896
16/16 [==============================] - 0s 692us/step - loss: 0.9198
16/16 [==============================] - 0s 662us/step - loss: 1.6543
16/16 [==============================] - 0s 644us/step - loss: 1.9879
16/16 [==============================] - 0s 1ms/step - loss: 2.0342
16/16 [==============================] - 0s 642us/step - loss: 2.0410
16/16 [==============================] - 0s 1ms/step - loss: 2.0401
16/16 [==============================] - 0s 1ms/step - loss: 2.0387
16/16 [==============================] - 0s 1ms/step - loss: 2.0376
16/16 [==============================] - 0s 1ms/step - loss: 2.0371

Testing for epoch 52 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2887
16/16 [==============================] - 0s 655us/step - loss: 0.9164
16/16 [==============================] - 0s 625us/step - loss: 1.6524
16/16 [==============================] - 0s 664us/step - loss: 1.9863
16/16 [==============================] - 0s 1ms/step - loss: 2.0320
16/16 [==============================] - 0s 1ms/step - loss: 2.0386
16/16 [==============================] - 0s 695us/step - loss: 2.0375
16/16 [==============================] - 0s 671us/step - loss: 2.0360
16/16 [==============================] - 0s 593us/step - loss: 2.0348
16/16 [==============================] - 0s 592us/step - loss: 2.0343
Epoch 53 of 60

Testing for epoch 53 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2903
16/16 [==============================] - 0s 652us/step - loss: 0.9111
16/16 [==============================] - 0s 634us/step - loss: 1.6388
16/16 [==============================] - 0s 820us/step - loss: 1.9646
16/16 [==============================] - 0s 1ms/step - loss: 2.0082
16/16 [==============================] - 0s 730us/step - loss: 2.0139
16/16 [==============================] - 0s 592us/step - loss: 2.0126
16/16 [==============================] - 0s 590us/step - loss: 2.0110
16/16 [==============================] - 0s 854us/step - loss: 2.0098
16/16 [==============================] - 0s 639us/step - loss: 2.0093

Testing for epoch 53 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2907
16/16 [==============================] - 0s 1ms/step - loss: 0.9147
16/16 [==============================] - 0s 719us/step - loss: 1.6530
16/16 [==============================] - 0s 658us/step - loss: 1.9850
16/16 [==============================] - 0s 634us/step - loss: 2.0298
16/16 [==============================] - 0s 653us/step - loss: 2.0361
16/16 [==============================] - 0s 2ms/step - loss: 2.0350
16/16 [==============================] - 0s 1ms/step - loss: 2.0335
16/16 [==============================] - 0s 625us/step - loss: 2.0324
16/16 [==============================] - 0s 2ms/step - loss: 2.0319
Epoch 54 of 60

Testing for epoch 54 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2956
16/16 [==============================] - 0s 1ms/step - loss: 0.9136
16/16 [==============================] - 0s 1ms/step - loss: 1.6438
16/16 [==============================] - 0s 1ms/step - loss: 1.9674
16/16 [==============================] - 0s 1ms/step - loss: 2.0101
16/16 [==============================] - 0s 1ms/step - loss: 2.0156
16/16 [==============================] - 0s 1ms/step - loss: 2.0143
16/16 [==============================] - 0s 1ms/step - loss: 2.0127
16/16 [==============================] - 0s 1ms/step - loss: 2.0116
16/16 [==============================] - 0s 1ms/step - loss: 2.0111

Testing for epoch 54 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2939
16/16 [==============================] - 0s 1ms/step - loss: 0.9110
16/16 [==============================] - 0s 1ms/step - loss: 1.6463
16/16 [==============================] - 0s 1ms/step - loss: 1.9729
16/16 [==============================] - 0s 2ms/step - loss: 2.0161
16/16 [==============================] - 0s 2ms/step - loss: 2.0218
16/16 [==============================] - 0s 1ms/step - loss: 2.0206
16/16 [==============================] - 0s 1ms/step - loss: 2.0191
16/16 [==============================] - 0s 1ms/step - loss: 2.0180
16/16 [==============================] - 0s 679us/step - loss: 2.0175
Epoch 55 of 60

Testing for epoch 55 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2919
16/16 [==============================] - 0s 2ms/step - loss: 0.9017
16/16 [==============================] - 0s 1ms/step - loss: 1.6263
16/16 [==============================] - 0s 1ms/step - loss: 1.9428
16/16 [==============================] - 0s 1ms/step - loss: 1.9832
16/16 [==============================] - 0s 1ms/step - loss: 1.9878
16/16 [==============================] - 0s 694us/step - loss: 1.9863
16/16 [==============================] - 0s 642us/step - loss: 1.9846
16/16 [==============================] - 0s 593us/step - loss: 1.9834
16/16 [==============================] - 0s 607us/step - loss: 1.9829

Testing for epoch 55 index 2:
16/16 [==============================] - 0s 627us/step - loss: 0.2932
16/16 [==============================] - 0s 619us/step - loss: 0.8949
16/16 [==============================] - 0s 621us/step - loss: 1.6136
16/16 [==============================] - 0s 623us/step - loss: 1.9271
16/16 [==============================] - 0s 610us/step - loss: 1.9666
16/16 [==============================] - 0s 1ms/step - loss: 1.9708
16/16 [==============================] - 0s 1ms/step - loss: 1.9692
16/16 [==============================] - 0s 629us/step - loss: 1.9675
16/16 [==============================] - 0s 1ms/step - loss: 1.9663
16/16 [==============================] - 0s 580us/step - loss: 1.9658
Epoch 56 of 60

Testing for epoch 56 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2877
16/16 [==============================] - 0s 1ms/step - loss: 0.9139
16/16 [==============================] - 0s 1ms/step - loss: 1.6633
16/16 [==============================] - 0s 1ms/step - loss: 1.9868
16/16 [==============================] - 0s 1ms/step - loss: 2.0271
16/16 [==============================] - 0s 654us/step - loss: 2.0314
16/16 [==============================] - 0s 683us/step - loss: 2.0298
16/16 [==============================] - 0s 615us/step - loss: 2.0281
16/16 [==============================] - 0s 1ms/step - loss: 2.0269
16/16 [==============================] - 0s 663us/step - loss: 2.0263

Testing for epoch 56 index 2:
16/16 [==============================] - 0s 742us/step - loss: 0.2883
16/16 [==============================] - 0s 641us/step - loss: 0.8940
16/16 [==============================] - 0s 1ms/step - loss: 1.6224
16/16 [==============================] - 0s 634us/step - loss: 1.9361
16/16 [==============================] - 0s 617us/step - loss: 1.9749
16/16 [==============================] - 0s 1ms/step - loss: 1.9788
16/16 [==============================] - 0s 628us/step - loss: 1.9771
16/16 [==============================] - 0s 628us/step - loss: 1.9755
16/16 [==============================] - 0s 1ms/step - loss: 1.9743
16/16 [==============================] - 0s 802us/step - loss: 1.9737
Epoch 57 of 60

Testing for epoch 57 index 1:
16/16 [==============================] - 0s 624us/step - loss: 0.2843
16/16 [==============================] - 0s 1ms/step - loss: 0.9090
16/16 [==============================] - 0s 1ms/step - loss: 1.6600
16/16 [==============================] - 0s 712us/step - loss: 1.9791
16/16 [==============================] - 0s 648us/step - loss: 2.0175
16/16 [==============================] - 0s 647us/step - loss: 2.0210
16/16 [==============================] - 0s 613us/step - loss: 2.0192
16/16 [==============================] - 0s 629us/step - loss: 2.0174
16/16 [==============================] - 0s 1ms/step - loss: 2.0162
16/16 [==============================] - 0s 859us/step - loss: 2.0156

Testing for epoch 57 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2836
16/16 [==============================] - 0s 1ms/step - loss: 0.9146
16/16 [==============================] - 0s 2ms/step - loss: 1.6782
16/16 [==============================] - 0s 1ms/step - loss: 2.0028
16/16 [==============================] - 0s 1ms/step - loss: 2.0419
16/16 [==============================] - 0s 1ms/step - loss: 2.0457
16/16 [==============================] - 0s 1ms/step - loss: 2.0439
16/16 [==============================] - 0s 1ms/step - loss: 2.0422
16/16 [==============================] - 0s 676us/step - loss: 2.0410
16/16 [==============================] - 0s 2ms/step - loss: 2.0405
Epoch 58 of 60

Testing for epoch 58 index 1:
16/16 [==============================] - 0s 684us/step - loss: 0.2791
16/16 [==============================] - 0s 1ms/step - loss: 0.9413
16/16 [==============================] - 0s 1ms/step - loss: 1.7429
16/16 [==============================] - 0s 1ms/step - loss: 2.0793
16/16 [==============================] - 0s 748us/step - loss: 2.1192
16/16 [==============================] - 0s 1ms/step - loss: 2.1229
16/16 [==============================] - 0s 657us/step - loss: 2.1211
16/16 [==============================] - 0s 826us/step - loss: 2.1193
16/16 [==============================] - 0s 654us/step - loss: 2.1181
16/16 [==============================] - 0s 662us/step - loss: 2.1176

Testing for epoch 58 index 2:
16/16 [==============================] - 0s 623us/step - loss: 0.2745
16/16 [==============================] - 0s 636us/step - loss: 0.9399
16/16 [==============================] - 0s 604us/step - loss: 1.7502
16/16 [==============================] - 0s 1ms/step - loss: 2.0900
16/16 [==============================] - 0s 1ms/step - loss: 2.1304
16/16 [==============================] - 0s 1ms/step - loss: 2.1343
16/16 [==============================] - 0s 2ms/step - loss: 2.1327
16/16 [==============================] - 0s 1ms/step - loss: 2.1310
16/16 [==============================] - 0s 1ms/step - loss: 2.1299
16/16 [==============================] - 0s 1ms/step - loss: 2.1293
Epoch 59 of 60

Testing for epoch 59 index 1:
16/16 [==============================] - 0s 850us/step - loss: 0.2705
16/16 [==============================] - 0s 624us/step - loss: 0.9431
16/16 [==============================] - 0s 626us/step - loss: 1.7595
16/16 [==============================] - 0s 946us/step - loss: 2.0960
16/16 [==============================] - 0s 631us/step - loss: 2.1341
16/16 [==============================] - 0s 653us/step - loss: 2.1372
16/16 [==============================] - 0s 1ms/step - loss: 2.1353
16/16 [==============================] - 0s 745us/step - loss: 2.1335
16/16 [==============================] - 0s 1ms/step - loss: 2.1322
16/16 [==============================] - 0s 1ms/step - loss: 2.1317

Testing for epoch 59 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 0.2706
16/16 [==============================] - 0s 1ms/step - loss: 0.9454
16/16 [==============================] - 0s 1ms/step - loss: 1.7683
16/16 [==============================] - 0s 1ms/step - loss: 2.1066
16/16 [==============================] - 0s 1ms/step - loss: 2.1448
16/16 [==============================] - 0s 1ms/step - loss: 2.1478
16/16 [==============================] - 0s 1ms/step - loss: 2.1459
16/16 [==============================] - 0s 1ms/step - loss: 2.1441
16/16 [==============================] - 0s 676us/step - loss: 2.1429
16/16 [==============================] - 0s 1ms/step - loss: 2.1423
Epoch 60 of 60

Testing for epoch 60 index 1:
16/16 [==============================] - 0s 648us/step - loss: 0.2763
16/16 [==============================] - 0s 1ms/step - loss: 0.9427
16/16 [==============================] - 0s 690us/step - loss: 1.7522
16/16 [==============================] - 0s 1ms/step - loss: 2.0797
16/16 [==============================] - 0s 717us/step - loss: 2.1151
16/16 [==============================] - 0s 650us/step - loss: 2.1173
16/16 [==============================] - 0s 1ms/step - loss: 2.1151
16/16 [==============================] - 0s 1ms/step - loss: 2.1133
16/16 [==============================] - 0s 674us/step - loss: 2.1120
16/16 [==============================] - 0s 1ms/step - loss: 2.1114

Testing for epoch 60 index 2:
16/16 [==============================] - 0s 660us/step - loss: 0.2810
16/16 [==============================] - 0s 668us/step - loss: 0.9270
16/16 [==============================] - 0s 615us/step - loss: 1.7161
16/16 [==============================] - 0s 637us/step - loss: 2.0351
16/16 [==============================] - 0s 1ms/step - loss: 2.0696
16/16 [==============================] - 0s 694us/step - loss: 2.0717
16/16 [==============================] - 0s 1ms/step - loss: 2.0696
16/16 [==============================] - 0s 641us/step - loss: 2.0678
16/16 [==============================] - 0s 599us/step - loss: 2.0666
16/16 [==============================] - 0s 624us/step - loss: 2.0660

outlier_MO_GAAL_one = list(clf.labels_)

outlier_MO_GAAL_one = list(map(lambda x: 1 if x==0  else -1,outlier_MO_GAAL_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_MO_GAAL_one,tab_linear)

_conf.conf("MO-GAAL (Liu et al., 2019)")

Accuracy: 0.879
Precision: 0.955
Recall: 0.916
F1 Score: 0.935

thirteen = twelve.append(_conf.tab)

LSCP

detectors = [KNN(), LOF(), OCSVM()]
clf = LSCP(detectors)
clf.fit(_df[['x', 'y']])
_df['LSCP_clf'] = clf.labels_

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/pyod/models/lscp.py:382: UserWarning: The number of histogram bins is greater than the number of classifiers, reducing n_bins to n_clf.
  warnings.warn(

outlier_LSCP_one = list(clf.labels_)

outlier_LSCP_one = list(map(lambda x: 1 if x==0  else -1,outlier_LSCP_one))

_conf = Conf_matrx(outlier_true_one_1,outlier_LSCP_one,tab_linear)

_conf.conf("LSCP (Zhao et al., 2019)")

Accuracy: 0.908
Precision: 0.977
Recall: 0.925
F1 Score: 0.950

fourteen_linear = thirteen.append(_conf.tab)

Linear Result

round(fourteen_linear,3)

	Accuracy	Precision	Recall	F1
GODE	0.959	0.960	0.999	0.979
LOF (Breunig et al., 2000)	0.890	0.973	0.909	0.940
kNN (Ramaswamy et al., 2000)	0.912	0.979	0.927	0.952
CBLOF (He et al., 2003)	0.920	0.958	0.958	0.958
OCSVM (Sch ̈olkopf et al., 2001)	0.909	0.978	0.925	0.951
MCD (Hardin and Rocke, 2004)	0.918	0.982	0.931	0.956
Feature Bagging (Lazarevic and Kumar, 2005)	0.918	0.982	0.931	0.956
ABOD (Kriegel et al., 2008)	0.946	0.972	0.972	0.972
Isolation Forest (Liu et al., 2008)	0.800	0.984	0.802	0.884
HBOS (Goldstein and Dengel, 2012)	0.889	0.960	0.921	0.940
SOS (Janssens et al., 2012)	0.889	0.960	0.921	0.940
SO-GAAL (Liu et al., 2019)	0.868	0.954	0.904	0.929
MO-GAAL (Liu et al., 2019)	0.879	0.955	0.916	0.935
LSCP (Zhao et al., 2019)	0.908	0.977	0.925	0.950

Orbit EbayesThresh

%load_ext rpy2.ipython

The rpy2.ipython extension is already loaded. To reload it, use:
  %reload_ext rpy2.ipython

%%R
library(EbayesThresh)
set.seed(1)
epsilon = rnorm(1000)
signal = sample(c(runif(25,-7,-5), runif(25,5,7), rep(0,950)))
index_of_trueoutlier = which(signal!=0)
index_of_trueoutlier
x=signal+epsilon
plot(1:1000,x)
points(index_of_trueoutlier,x[index_of_trueoutlier],col=2,cex=4)

#plot(x,type='l')
#mu <- EbayesThresh::ebayesthresh(x,sdev=2)
#lines(mu,col=2,lty=2,lwd=2)

%R -o x
%R -o index_of_trueoutlier
%R -o signal

ebayesthresh = importr('EbayesThresh').ebayesthresh

xhat = np.array(ebayesthresh(FloatVector(x)))

# plt.plot(x)
# plt.plot(xhat)

outlier_true_index = index_of_trueoutlier

outlier_true_value = x[index_of_trueoutlier]

package와 비교를 위해 outlier는 -1, inlier는 1로 표시

outlier_true_one = signal.copy()

outlier_true_one = list(map(lambda x: -1 if x!=0 else 1,outlier_true_one))

Orbit

np.random.seed(777)
pi=np.pi
n=1000
ang=np.linspace(-pi,pi-2*pi/n,n)
r=5+np.cos(np.linspace(0,12*pi,n))
vx=r*np.cos(ang)
vy=r*np.sin(ang)
f1=10*np.sin(np.linspace(0,6*pi,n))
f = f1 + x

_df = pd.DataFrame({'x' : vx, 'y' : vy, 'f' : f})

X = np.array(_df)

GODE

_Orbit = Orbit(_df)

_Orbit.get_distance()

100%|██████████| 1000/1000 [00:02<00:00, 497.54it/s]

_Orbit.get_weightmatrix(theta=(_Orbit.D[_Orbit.D>0].mean()),kappa=2500) 

_Orbit.fit(sd=15,ref=20)

outlier_simul_one = (_Orbit.df['Residual']**2).tolist()

outlier_simul_one = list(map(lambda x: -1 if x > 20 else 1,outlier_simul_one))

_conf = Conf_matrx(outlier_true_one,outlier_simul_one,tab_orbit)

_conf.conf("GODE")

Accuracy: 0.997
Precision: 0.997
Recall: 1.000
F1 Score: 0.998

one = _conf.tab

LOF

clf = LocalOutlierFactor(n_neighbors=2)

_conf = Conf_matrx(outlier_true_one,clf.fit_predict(X),tab_orbit)

_conf.conf("LOF (Breunig et al., 2000)")

Accuracy: 0.886
Precision: 0.987
Recall: 0.892
F1 Score: 0.937

two = one.append(_conf.tab)

KNN

clf = KNN()
clf.fit(_df[['x', 'y','f']])
_df['knn_clf'] = clf.labels_

outlier_KNN_one = list(clf.labels_)

outlier_KNN_one = list(map(lambda x: 1 if x==0  else -1,outlier_KNN_one))

_conf = Conf_matrx(outlier_true_one,outlier_KNN_one,tab_orbit)

_conf.conf("kNN (Ramaswamy et al., 2000)")

Accuracy: 0.948
Precision: 0.999
Recall: 0.946
F1 Score: 0.972

three = two.append(_conf.tab)

CBLOF

clf = CBLOF(contamination=0.05,check_estimator=False, random_state=77)
clf.fit(_df[['x', 'y','f']])
_df['CBLOF_Clf'] = clf.labels_

outlier_CBLOF_one = list(clf.labels_)

outlier_CBLOF_one = list(map(lambda x: 1 if x==0  else -1,outlier_CBLOF_one))

_conf = Conf_matrx(outlier_true_one,outlier_CBLOF_one,tab_orbit)

_conf.conf("CBLOF (He et al., 2003)")

Accuracy: 0.918
Precision: 0.957
Recall: 0.957
F1 Score: 0.957

four = three.append(_conf.tab)

OCSVM

clf = svm.OneClassSVM(nu=0.1, kernel="rbf", gamma=0.1)

clf.fit(X)

OneClassSVM(gamma=0.1, nu=0.1)

outlier_OSVM_one = list(clf.predict(X))

_conf = Conf_matrx(outlier_true_one,outlier_OSVM_one,tab_orbit)

_conf.conf("OCSVM (Sch ̈olkopf et al., 2001)")

Accuracy: 0.923
Precision: 0.988
Recall: 0.931
F1 Score: 0.958

five = four.append(_conf.tab)

MCD

clf = MCD()
clf.fit(_df[['x', 'y','f']])
_df['MCD_clf'] = clf.labels_

outlier_MCD_one = list(clf.labels_)

outlier_MCD_one = list(map(lambda x: 1 if x==0  else -1,outlier_MCD_one))

_conf = Conf_matrx(outlier_true_one,outlier_MCD_one,tab_orbit)

_conf.conf("MCD (Hardin and Rocke, 2004)")

Accuracy: 0.866
Precision: 0.953
Recall: 0.903
F1 Score: 0.928

six = five.append(_conf.tab)

Feature Bagging

clf = FeatureBagging()
clf.fit(_df[['x', 'y','f']])
_df['FeatureBagging_clf'] = clf.labels_

outlier_FeatureBagging_one = list(clf.labels_)

outlier_FeatureBagging_one = list(map(lambda x: 1 if x==0  else -1,outlier_FeatureBagging_one))

_conf = Conf_matrx(outlier_true_one,outlier_FeatureBagging_one,tab_orbit)

_conf.conf("Feature Bagging (Lazarevic and Kumar, 2005)")

Accuracy: 0.912
Precision: 0.979
Recall: 0.927
F1 Score: 0.952

seven = six.append(_conf.tab)

ABOD

clf = ABOD(contamination=0.05)
clf.fit(_df[['x', 'y','f']])
_df['ABOD_Clf'] = clf.labels_

outlier_ABOD_one = list(clf.labels_)

outlier_ABOD_one = list(map(lambda x: 1 if x==0  else -1,outlier_ABOD_one))

_conf = Conf_matrx(outlier_true_one,outlier_ABOD_one,tab_orbit)

_conf.conf("ABOD (Kriegel et al., 2008)")

Accuracy: 0.988
Precision: 0.994
Recall: 0.994
F1 Score: 0.994

eight = seven.append(_conf.tab)

IForest

od = IForest(
    threshold=0.,
    n_estimators=100
)

od.fit(_df[['x', 'y','f']])

preds = od.predict(
    _df[['x', 'y','f']],
    return_instance_score=True
)

_df['IF_alibi'] = preds['data']['is_outlier']

outlier_alibi_one = _df['IF_alibi']

outlier_alibi_one = list(map(lambda x: 1 if x==0  else -1,outlier_alibi_one))

_conf = Conf_matrx(outlier_true_one,outlier_alibi_one,tab_orbit)

_conf.conf("Isolation Forest (Liu et al., 2008)")

Accuracy: 0.378
Precision: 0.997
Recall: 0.346
F1 Score: 0.514

nine = eight.append(_conf.tab)

HBOS

clf = HBOS()
clf.fit(_df[['x', 'y','f']])
_df['HBOS_clf'] = clf.labels_

outlier_HBOS_one = list(clf.labels_)

outlier_HBOS_one = list(map(lambda x: 1 if x==0  else -1,outlier_HBOS_one))

_conf = Conf_matrx(outlier_true_one,outlier_HBOS_one,tab_orbit)

_conf.conf("HBOS (Goldstein and Dengel, 2012)")

Accuracy: 0.881
Precision: 0.961
Recall: 0.912
F1 Score: 0.936

ten = nine.append(_conf.tab)

SOS

outlier_SOS_one = list(clf.labels_)

outlier_SOS_one = list(map(lambda x: 1 if x==0  else -1,outlier_SOS_one))

clf = SOS()
clf.fit(_df[['x', 'y','f']])
_df['SOS_clf'] = clf.labels_

_conf = Conf_matrx(outlier_true_one,outlier_SOS_one,tab_orbit)

_conf.conf("SOS (Janssens et al., 2012)")

Accuracy: 0.881
Precision: 0.961
Recall: 0.912
F1 Score: 0.936

eleven = ten.append(_conf.tab)

SO_GAAL

clf = SO_GAAL()
clf.fit(_df[['x', 'y','f']])
_df['SO_GAAL_clf'] = clf.labels_

Epoch 1 of 60

Testing for epoch 1 index 1:

Testing for epoch 1 index 2:
Epoch 2 of 60

Testing for epoch 2 index 1:

Testing for epoch 2 index 2:
Epoch 3 of 60

Testing for epoch 3 index 1:

Testing for epoch 3 index 2:
Epoch 4 of 60

Testing for epoch 4 index 1:

Testing for epoch 4 index 2:
Epoch 5 of 60

Testing for epoch 5 index 1:

Testing for epoch 5 index 2:
Epoch 6 of 60

Testing for epoch 6 index 1:

Testing for epoch 6 index 2:
Epoch 7 of 60

Testing for epoch 7 index 1:

Testing for epoch 7 index 2:
Epoch 8 of 60

Testing for epoch 8 index 1:

Testing for epoch 8 index 2:
Epoch 9 of 60

Testing for epoch 9 index 1:

Testing for epoch 9 index 2:
Epoch 10 of 60

Testing for epoch 10 index 1:

Testing for epoch 10 index 2:
Epoch 11 of 60

Testing for epoch 11 index 1:

Testing for epoch 11 index 2:
Epoch 12 of 60

Testing for epoch 12 index 1:

Testing for epoch 12 index 2:
Epoch 13 of 60

Testing for epoch 13 index 1:

Testing for epoch 13 index 2:
Epoch 14 of 60

Testing for epoch 14 index 1:

Testing for epoch 14 index 2:
Epoch 15 of 60

Testing for epoch 15 index 1:

Testing for epoch 15 index 2:
Epoch 16 of 60

Testing for epoch 16 index 1:

Testing for epoch 16 index 2:
Epoch 17 of 60

Testing for epoch 17 index 1:

Testing for epoch 17 index 2:
Epoch 18 of 60

Testing for epoch 18 index 1:

Testing for epoch 18 index 2:
Epoch 19 of 60

Testing for epoch 19 index 1:

Testing for epoch 19 index 2:
Epoch 20 of 60

Testing for epoch 20 index 1:

Testing for epoch 20 index 2:
Epoch 21 of 60

Testing for epoch 21 index 1:

Testing for epoch 21 index 2:
Epoch 22 of 60

Testing for epoch 22 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.2135

Testing for epoch 22 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.2178
Epoch 23 of 60

Testing for epoch 23 index 1:
16/16 [==============================] - 0s 891us/step - loss: 1.2227

Testing for epoch 23 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.2138
Epoch 24 of 60

Testing for epoch 24 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.2244

Testing for epoch 24 index 2:
16/16 [==============================] - 0s 917us/step - loss: 1.2068
Epoch 25 of 60

Testing for epoch 25 index 1:
16/16 [==============================] - 0s 624us/step - loss: 1.2319

Testing for epoch 25 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.2260
Epoch 26 of 60

Testing for epoch 26 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.2357

Testing for epoch 26 index 2:
16/16 [==============================] - 0s 985us/step - loss: 1.2294
Epoch 27 of 60

Testing for epoch 27 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.2426

Testing for epoch 27 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.2583
Epoch 28 of 60

Testing for epoch 28 index 1:
16/16 [==============================] - 0s 815us/step - loss: 1.2599

Testing for epoch 28 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.2752
Epoch 29 of 60

Testing for epoch 29 index 1:
16/16 [==============================] - 0s 639us/step - loss: 1.3019

Testing for epoch 29 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.2905
Epoch 30 of 60

Testing for epoch 30 index 1:
16/16 [==============================] - 0s 635us/step - loss: 1.3191

Testing for epoch 30 index 2:
16/16 [==============================] - 0s 781us/step - loss: 1.3229
Epoch 31 of 60

Testing for epoch 31 index 1:
16/16 [==============================] - 0s 604us/step - loss: 1.3371

Testing for epoch 31 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.3418
Epoch 32 of 60

Testing for epoch 32 index 1:
16/16 [==============================] - 0s 803us/step - loss: 1.3589

Testing for epoch 32 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.3819
Epoch 33 of 60

Testing for epoch 33 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.3966

Testing for epoch 33 index 2:
16/16 [==============================] - 0s 956us/step - loss: 1.3947
Epoch 34 of 60

Testing for epoch 34 index 1:
16/16 [==============================] - 0s 609us/step - loss: 1.4201

Testing for epoch 34 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.4322
Epoch 35 of 60

Testing for epoch 35 index 1:
16/16 [==============================] - 0s 617us/step - loss: 1.4333

Testing for epoch 35 index 2:
16/16 [==============================] - 0s 626us/step - loss: 1.4465
Epoch 36 of 60

Testing for epoch 36 index 1:
16/16 [==============================] - 0s 640us/step - loss: 1.4560

Testing for epoch 36 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.4823
Epoch 37 of 60

Testing for epoch 37 index 1:
16/16 [==============================] - 0s 932us/step - loss: 1.4888

Testing for epoch 37 index 2:
16/16 [==============================] - 0s 782us/step - loss: 1.5030
Epoch 38 of 60

Testing for epoch 38 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.5161

Testing for epoch 38 index 2:
16/16 [==============================] - 0s 599us/step - loss: 1.5196
Epoch 39 of 60

Testing for epoch 39 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.5412

Testing for epoch 39 index 2:
16/16 [==============================] - 0s 877us/step - loss: 1.5368
Epoch 40 of 60

Testing for epoch 40 index 1:
16/16 [==============================] - 0s 579us/step - loss: 1.5523

Testing for epoch 40 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.5574
Epoch 41 of 60

Testing for epoch 41 index 1:
16/16 [==============================] - 0s 981us/step - loss: 1.5684

Testing for epoch 41 index 2:
16/16 [==============================] - 0s 643us/step - loss: 1.5748
Epoch 42 of 60

Testing for epoch 42 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.5725

Testing for epoch 42 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.5772
Epoch 43 of 60

Testing for epoch 43 index 1:
16/16 [==============================] - 0s 648us/step - loss: 1.5934

Testing for epoch 43 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.6053
Epoch 44 of 60

Testing for epoch 44 index 1:
16/16 [==============================] - 0s 907us/step - loss: 1.6078

Testing for epoch 44 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.6025
Epoch 45 of 60

Testing for epoch 45 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.6277

Testing for epoch 45 index 2:
16/16 [==============================] - 0s 615us/step - loss: 1.6348
Epoch 46 of 60

Testing for epoch 46 index 1:
16/16 [==============================] - 0s 815us/step - loss: 1.6427

Testing for epoch 46 index 2:
16/16 [==============================] - 0s 606us/step - loss: 1.6405
Epoch 47 of 60

Testing for epoch 47 index 1:
16/16 [==============================] - 0s 619us/step - loss: 1.6498

Testing for epoch 47 index 2:
16/16 [==============================] - 0s 812us/step - loss: 1.6603
Epoch 48 of 60

Testing for epoch 48 index 1:
16/16 [==============================] - 0s 614us/step - loss: 1.6775

Testing for epoch 48 index 2:
16/16 [==============================] - 0s 650us/step - loss: 1.6890
Epoch 49 of 60

Testing for epoch 49 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.6979

Testing for epoch 49 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.6971
Epoch 50 of 60

Testing for epoch 50 index 1:
16/16 [==============================] - 0s 624us/step - loss: 1.7076

Testing for epoch 50 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.7120
Epoch 51 of 60

Testing for epoch 51 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.7271

Testing for epoch 51 index 2:
16/16 [==============================] - 0s 863us/step - loss: 1.7406
Epoch 52 of 60

Testing for epoch 52 index 1:
16/16 [==============================] - 0s 623us/step - loss: 1.7534

Testing for epoch 52 index 2:
16/16 [==============================] - 0s 677us/step - loss: 1.7597
Epoch 53 of 60

Testing for epoch 53 index 1:
16/16 [==============================] - 0s 741us/step - loss: 1.7555

Testing for epoch 53 index 2:
16/16 [==============================] - 0s 678us/step - loss: 1.7716
Epoch 54 of 60

Testing for epoch 54 index 1:
16/16 [==============================] - 0s 827us/step - loss: 1.7776

Testing for epoch 54 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.7776
Epoch 55 of 60

Testing for epoch 55 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.8009

Testing for epoch 55 index 2:
16/16 [==============================] - 0s 626us/step - loss: 1.8053
Epoch 56 of 60

Testing for epoch 56 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.8205

Testing for epoch 56 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8218
Epoch 57 of 60

Testing for epoch 57 index 1:
16/16 [==============================] - 0s 666us/step - loss: 1.8259

Testing for epoch 57 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8307
Epoch 58 of 60

Testing for epoch 58 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.8576

Testing for epoch 58 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8445
Epoch 59 of 60

Testing for epoch 59 index 1:
16/16 [==============================] - 0s 742us/step - loss: 1.8687

Testing for epoch 59 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8710
Epoch 60 of 60

Testing for epoch 60 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.8824

Testing for epoch 60 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8924

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/keras/optimizer_v2/gradient_descent.py:102: UserWarning: The `lr` argument is deprecated, use `learning_rate` instead.
  super(SGD, self).__init__(name, **kwargs)

outlier_SO_GAAL_one = list(clf.labels_)

outlier_SO_GAAL_one = list(map(lambda x: 1 if x==0  else -1,outlier_SO_GAAL_one))

_conf = Conf_matrx(outlier_true_one,outlier_SO_GAAL_one,tab_orbit)

_conf.conf("SO-GAAL (Liu et al., 2019)")

Accuracy: 0.876
Precision: 0.959
Recall: 0.908
F1 Score: 0.933

twelve = eleven.append(_conf.tab)

MO_GAAL

clf = MO_GAAL()
clf.fit(_df[['x', 'y','f']])
_df['MO_GAAL_clf'] = clf.labels_

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/keras/optimizer_v2/gradient_descent.py:102: UserWarning: The `lr` argument is deprecated, use `learning_rate` instead.
  super(SGD, self).__init__(name, **kwargs)

Epoch 1 of 60

Testing for epoch 1 index 1:

Testing for epoch 1 index 2:
Epoch 2 of 60

Testing for epoch 2 index 1:

Testing for epoch 2 index 2:
Epoch 3 of 60

Testing for epoch 3 index 1:

Testing for epoch 3 index 2:
Epoch 4 of 60

Testing for epoch 4 index 1:

Testing for epoch 4 index 2:
Epoch 5 of 60

Testing for epoch 5 index 1:

Testing for epoch 5 index 2:
Epoch 6 of 60

Testing for epoch 6 index 1:

Testing for epoch 6 index 2:
Epoch 7 of 60

Testing for epoch 7 index 1:

Testing for epoch 7 index 2:
Epoch 8 of 60

Testing for epoch 8 index 1:

Testing for epoch 8 index 2:
Epoch 9 of 60

Testing for epoch 9 index 1:

Testing for epoch 9 index 2:
Epoch 10 of 60

Testing for epoch 10 index 1:

Testing for epoch 10 index 2:
Epoch 11 of 60

Testing for epoch 11 index 1:

Testing for epoch 11 index 2:
Epoch 12 of 60

Testing for epoch 12 index 1:

Testing for epoch 12 index 2:
Epoch 13 of 60

Testing for epoch 13 index 1:

Testing for epoch 13 index 2:
Epoch 14 of 60

Testing for epoch 14 index 1:

Testing for epoch 14 index 2:
Epoch 15 of 60

Testing for epoch 15 index 1:

Testing for epoch 15 index 2:
Epoch 16 of 60

Testing for epoch 16 index 1:

Testing for epoch 16 index 2:
Epoch 17 of 60

Testing for epoch 17 index 1:

Testing for epoch 17 index 2:
Epoch 18 of 60

Testing for epoch 18 index 1:

Testing for epoch 18 index 2:
Epoch 19 of 60

Testing for epoch 19 index 1:

Testing for epoch 19 index 2:
Epoch 20 of 60

Testing for epoch 20 index 1:

Testing for epoch 20 index 2:
Epoch 21 of 60

Testing for epoch 21 index 1:

Testing for epoch 21 index 2:
16/16 [==============================] - 0s 638us/step - loss: 0.5986
16/16 [==============================] - 0s 1ms/step - loss: 1.2168
16/16 [==============================] - 0s 643us/step - loss: 1.2657
16/16 [==============================] - 0s 637us/step - loss: 1.2688
16/16 [==============================] - 0s 1ms/step - loss: 1.2695
16/16 [==============================] - 0s 1ms/step - loss: 1.2696
16/16 [==============================] - 0s 653us/step - loss: 1.2696
16/16 [==============================] - 0s 649us/step - loss: 1.2696
16/16 [==============================] - 0s 711us/step - loss: 1.2696
16/16 [==============================] - 0s 1ms/step - loss: 1.2696
Epoch 22 of 60

Testing for epoch 22 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.6392
16/16 [==============================] - 0s 664us/step - loss: 1.2086
16/16 [==============================] - 0s 711us/step - loss: 1.2461
16/16 [==============================] - 0s 2ms/step - loss: 1.2488
16/16 [==============================] - 0s 707us/step - loss: 1.2493
16/16 [==============================] - 0s 628us/step - loss: 1.2494
16/16 [==============================] - 0s 642us/step - loss: 1.2494
16/16 [==============================] - 0s 698us/step - loss: 1.2494
16/16 [==============================] - 0s 674us/step - loss: 1.2494
16/16 [==============================] - 0s 788us/step - loss: 1.2494

Testing for epoch 22 index 2:
16/16 [==============================] - 0s 663us/step - loss: 0.6763
16/16 [==============================] - 0s 1ms/step - loss: 1.2250
16/16 [==============================] - 0s 1ms/step - loss: 1.2559
16/16 [==============================] - 0s 642us/step - loss: 1.2583
16/16 [==============================] - 0s 1ms/step - loss: 1.2588
16/16 [==============================] - 0s 672us/step - loss: 1.2589
16/16 [==============================] - 0s 629us/step - loss: 1.2589
16/16 [==============================] - 0s 1ms/step - loss: 1.2589
16/16 [==============================] - 0s 1ms/step - loss: 1.2589
16/16 [==============================] - 0s 1ms/step - loss: 1.2589
Epoch 23 of 60

Testing for epoch 23 index 1:
16/16 [==============================] - 0s 658us/step - loss: 0.7044
16/16 [==============================] - 0s 682us/step - loss: 1.2426
16/16 [==============================] - 0s 661us/step - loss: 1.2710
16/16 [==============================] - 0s 1ms/step - loss: 1.2733
16/16 [==============================] - 0s 757us/step - loss: 1.2738
16/16 [==============================] - 0s 725us/step - loss: 1.2739
16/16 [==============================] - 0s 1ms/step - loss: 1.2739
16/16 [==============================] - 0s 1ms/step - loss: 1.2739
16/16 [==============================] - 0s 638us/step - loss: 1.2739
16/16 [==============================] - 0s 648us/step - loss: 1.2739

Testing for epoch 23 index 2:
16/16 [==============================] - 0s 660us/step - loss: 0.7203
16/16 [==============================] - 0s 878us/step - loss: 1.2467
16/16 [==============================] - 0s 647us/step - loss: 1.2715
16/16 [==============================] - 0s 1ms/step - loss: 1.2737
16/16 [==============================] - 0s 1ms/step - loss: 1.2741
16/16 [==============================] - 0s 637us/step - loss: 1.2742
16/16 [==============================] - 0s 656us/step - loss: 1.2742
16/16 [==============================] - 0s 1ms/step - loss: 1.2742
16/16 [==============================] - 0s 645us/step - loss: 1.2742
16/16 [==============================] - 0s 689us/step - loss: 1.2742
Epoch 24 of 60

Testing for epoch 24 index 1:
16/16 [==============================] - 0s 656us/step - loss: 0.7260
16/16 [==============================] - 0s 1ms/step - loss: 1.2580
16/16 [==============================] - 0s 655us/step - loss: 1.2817
16/16 [==============================] - 0s 1ms/step - loss: 1.2839
16/16 [==============================] - 0s 846us/step - loss: 1.2844
16/16 [==============================] - 0s 696us/step - loss: 1.2844
16/16 [==============================] - 0s 926us/step - loss: 1.2845
16/16 [==============================] - 0s 661us/step - loss: 1.2845
16/16 [==============================] - 0s 1ms/step - loss: 1.2845
16/16 [==============================] - 0s 1ms/step - loss: 1.2845

Testing for epoch 24 index 2:
16/16 [==============================] - 0s 641us/step - loss: 0.7292
16/16 [==============================] - 0s 632us/step - loss: 1.2735
16/16 [==============================] - 0s 780us/step - loss: 1.2970
16/16 [==============================] - 0s 1ms/step - loss: 1.2995
16/16 [==============================] - 0s 637us/step - loss: 1.2999
16/16 [==============================] - 0s 1ms/step - loss: 1.3000
16/16 [==============================] - 0s 1ms/step - loss: 1.3000
16/16 [==============================] - 0s 981us/step - loss: 1.3000
16/16 [==============================] - 0s 1ms/step - loss: 1.3000
16/16 [==============================] - 0s 1ms/step - loss: 1.3000
Epoch 25 of 60

Testing for epoch 25 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.7228
16/16 [==============================] - 0s 1ms/step - loss: 1.2928
16/16 [==============================] - 0s 1ms/step - loss: 1.3171
16/16 [==============================] - 0s 821us/step - loss: 1.3198
16/16 [==============================] - 0s 611us/step - loss: 1.3203
16/16 [==============================] - 0s 690us/step - loss: 1.3204
16/16 [==============================] - 0s 647us/step - loss: 1.3204
16/16 [==============================] - 0s 1ms/step - loss: 1.3204
16/16 [==============================] - 0s 974us/step - loss: 1.3204
16/16 [==============================] - 0s 589us/step - loss: 1.3204

Testing for epoch 25 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.7136
16/16 [==============================] - 0s 1ms/step - loss: 1.3031
16/16 [==============================] - 0s 643us/step - loss: 1.3286
16/16 [==============================] - 0s 1ms/step - loss: 1.3313
16/16 [==============================] - 0s 948us/step - loss: 1.3319
16/16 [==============================] - 0s 1ms/step - loss: 1.3320
16/16 [==============================] - 0s 802us/step - loss: 1.3320
16/16 [==============================] - 0s 1ms/step - loss: 1.3320
16/16 [==============================] - 0s 1ms/step - loss: 1.3320
16/16 [==============================] - 0s 837us/step - loss: 1.3320
Epoch 26 of 60

Testing for epoch 26 index 1:
16/16 [==============================] - 0s 631us/step - loss: 0.6966
16/16 [==============================] - 0s 1ms/step - loss: 1.3288
16/16 [==============================] - 0s 820us/step - loss: 1.3566
16/16 [==============================] - 0s 934us/step - loss: 1.3598
16/16 [==============================] - 0s 1ms/step - loss: 1.3604
16/16 [==============================] - 0s 1ms/step - loss: 1.3605
16/16 [==============================] - 0s 1ms/step - loss: 1.3605
16/16 [==============================] - 0s 635us/step - loss: 1.3605
16/16 [==============================] - 0s 865us/step - loss: 1.3605
16/16 [==============================] - 0s 630us/step - loss: 1.3605

Testing for epoch 26 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.6781
16/16 [==============================] - 0s 1ms/step - loss: 1.3420
16/16 [==============================] - 0s 862us/step - loss: 1.3719
16/16 [==============================] - 0s 635us/step - loss: 1.3756
16/16 [==============================] - 0s 611us/step - loss: 1.3763
16/16 [==============================] - 0s 626us/step - loss: 1.3764
16/16 [==============================] - 0s 796us/step - loss: 1.3764
16/16 [==============================] - 0s 1ms/step - loss: 1.3764
16/16 [==============================] - 0s 920us/step - loss: 1.3764
16/16 [==============================] - 0s 596us/step - loss: 1.3764
Epoch 27 of 60

Testing for epoch 27 index 1:
16/16 [==============================] - 0s 629us/step - loss: 0.6549
16/16 [==============================] - 0s 1ms/step - loss: 1.3709
16/16 [==============================] - 0s 712us/step - loss: 1.4048
16/16 [==============================] - 0s 724us/step - loss: 1.4090
16/16 [==============================] - 0s 749us/step - loss: 1.4098
16/16 [==============================] - 0s 653us/step - loss: 1.4099
16/16 [==============================] - 0s 629us/step - loss: 1.4099
16/16 [==============================] - 0s 1ms/step - loss: 1.4099
16/16 [==============================] - 0s 723us/step - loss: 1.4099
16/16 [==============================] - 0s 634us/step - loss: 1.4099

Testing for epoch 27 index 2:
16/16 [==============================] - 0s 625us/step - loss: 0.6334
16/16 [==============================] - 0s 618us/step - loss: 1.3962
16/16 [==============================] - 0s 603us/step - loss: 1.4358
16/16 [==============================] - 0s 1ms/step - loss: 1.4403
16/16 [==============================] - 0s 1ms/step - loss: 1.4413
16/16 [==============================] - 0s 1ms/step - loss: 1.4414
16/16 [==============================] - 0s 893us/step - loss: 1.4415
16/16 [==============================] - 0s 598us/step - loss: 1.4415
16/16 [==============================] - 0s 1ms/step - loss: 1.4414
16/16 [==============================] - 0s 1ms/step - loss: 1.4414
Epoch 28 of 60

Testing for epoch 28 index 1:
16/16 [==============================] - 0s 662us/step - loss: 0.6050
16/16 [==============================] - 0s 1ms/step - loss: 1.4078
16/16 [==============================] - 0s 1ms/step - loss: 1.4521
16/16 [==============================] - 0s 818us/step - loss: 1.4572
16/16 [==============================] - 0s 993us/step - loss: 1.4584
16/16 [==============================] - 0s 1ms/step - loss: 1.4585
16/16 [==============================] - 0s 1ms/step - loss: 1.4586
16/16 [==============================] - 0s 1ms/step - loss: 1.4586
16/16 [==============================] - 0s 765us/step - loss: 1.4585
16/16 [==============================] - 0s 1ms/step - loss: 1.4585

Testing for epoch 28 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.5843
16/16 [==============================] - 0s 739us/step - loss: 1.4360
16/16 [==============================] - 0s 1ms/step - loss: 1.4867
16/16 [==============================] - 0s 582us/step - loss: 1.4928
16/16 [==============================] - 0s 1ms/step - loss: 1.4941
16/16 [==============================] - 0s 684us/step - loss: 1.4943
16/16 [==============================] - 0s 884us/step - loss: 1.4943
16/16 [==============================] - 0s 746us/step - loss: 1.4943
16/16 [==============================] - 0s 997us/step - loss: 1.4943
16/16 [==============================] - 0s 1ms/step - loss: 1.4942
Epoch 29 of 60

Testing for epoch 29 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.5581
16/16 [==============================] - 0s 1ms/step - loss: 1.4546
16/16 [==============================] - 0s 1ms/step - loss: 1.5115
16/16 [==============================] - 0s 1ms/step - loss: 1.5182
16/16 [==============================] - 0s 1ms/step - loss: 1.5197
16/16 [==============================] - 0s 1ms/step - loss: 1.5199
16/16 [==============================] - 0s 1ms/step - loss: 1.5199
16/16 [==============================] - 0s 612us/step - loss: 1.5199
16/16 [==============================] - 0s 650us/step - loss: 1.5199
16/16 [==============================] - 0s 642us/step - loss: 1.5199

Testing for epoch 29 index 2:
16/16 [==============================] - 0s 601us/step - loss: 0.5402
16/16 [==============================] - 0s 900us/step - loss: 1.4761
16/16 [==============================] - 0s 1ms/step - loss: 1.5388
16/16 [==============================] - 0s 1ms/step - loss: 1.5458
16/16 [==============================] - 0s 1ms/step - loss: 1.5476
16/16 [==============================] - 0s 1ms/step - loss: 1.5478
16/16 [==============================] - 0s 1ms/step - loss: 1.5478
16/16 [==============================] - 0s 593us/step - loss: 1.5478
16/16 [==============================] - 0s 1ms/step - loss: 1.5478
16/16 [==============================] - 0s 1ms/step - loss: 1.5478
Epoch 30 of 60

Testing for epoch 30 index 1:
16/16 [==============================] - 0s 769us/step - loss: 0.5184
16/16 [==============================] - 0s 606us/step - loss: 1.5000
16/16 [==============================] - 0s 908us/step - loss: 1.5668
16/16 [==============================] - 0s 1ms/step - loss: 1.5748
16/16 [==============================] - 0s 1ms/step - loss: 1.5767
16/16 [==============================] - 0s 1ms/step - loss: 1.5769
16/16 [==============================] - 0s 1ms/step - loss: 1.5769
16/16 [==============================] - 0s 705us/step - loss: 1.5769
16/16 [==============================] - 0s 613us/step - loss: 1.5769
16/16 [==============================] - 0s 671us/step - loss: 1.5768

Testing for epoch 30 index 2:
16/16 [==============================] - 0s 603us/step - loss: 0.5062
16/16 [==============================] - 0s 629us/step - loss: 1.5280
16/16 [==============================] - 0s 751us/step - loss: 1.5999
16/16 [==============================] - 0s 615us/step - loss: 1.6088
16/16 [==============================] - 0s 929us/step - loss: 1.6109
16/16 [==============================] - 0s 1ms/step - loss: 1.6112
16/16 [==============================] - 0s 1ms/step - loss: 1.6112
16/16 [==============================] - 0s 613us/step - loss: 1.6112
16/16 [==============================] - 0s 1ms/step - loss: 1.6112
16/16 [==============================] - 0s 876us/step - loss: 1.6112
Epoch 31 of 60

Testing for epoch 31 index 1:
16/16 [==============================] - 0s 663us/step - loss: 0.4910
16/16 [==============================] - 0s 1ms/step - loss: 1.5266
16/16 [==============================] - 0s 1ms/step - loss: 1.6021
16/16 [==============================] - 0s 1ms/step - loss: 1.6113
16/16 [==============================] - 0s 763us/step - loss: 1.6135
16/16 [==============================] - 0s 956us/step - loss: 1.6138
16/16 [==============================] - 0s 611us/step - loss: 1.6139
16/16 [==============================] - 0s 613us/step - loss: 1.6139
16/16 [==============================] - 0s 1ms/step - loss: 1.6138
16/16 [==============================] - 0s 718us/step - loss: 1.6138

Testing for epoch 31 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.4859
16/16 [==============================] - 0s 622us/step - loss: 1.5514
16/16 [==============================] - 0s 608us/step - loss: 1.6294
16/16 [==============================] - 0s 1ms/step - loss: 1.6390
16/16 [==============================] - 0s 634us/step - loss: 1.6414
16/16 [==============================] - 0s 593us/step - loss: 1.6417
16/16 [==============================] - 0s 656us/step - loss: 1.6417
16/16 [==============================] - 0s 606us/step - loss: 1.6417
16/16 [==============================] - 0s 627us/step - loss: 1.6417
16/16 [==============================] - 0s 951us/step - loss: 1.6416
Epoch 32 of 60

Testing for epoch 32 index 1:
16/16 [==============================] - 0s 886us/step - loss: 0.4775
16/16 [==============================] - 0s 631us/step - loss: 1.5698
16/16 [==============================] - 0s 1ms/step - loss: 1.6491
16/16 [==============================] - 0s 1ms/step - loss: 1.6591
16/16 [==============================] - 0s 642us/step - loss: 1.6617
16/16 [==============================] - 0s 1ms/step - loss: 1.6620
16/16 [==============================] - 0s 606us/step - loss: 1.6621
16/16 [==============================] - 0s 649us/step - loss: 1.6620
16/16 [==============================] - 0s 622us/step - loss: 1.6620
16/16 [==============================] - 0s 621us/step - loss: 1.6619

Testing for epoch 32 index 2:
16/16 [==============================] - 0s 629us/step - loss: 0.4795
16/16 [==============================] - 0s 638us/step - loss: 1.5898
16/16 [==============================] - 0s 634us/step - loss: 1.6681
16/16 [==============================] - 0s 1ms/step - loss: 1.6781
16/16 [==============================] - 0s 677us/step - loss: 1.6809
16/16 [==============================] - 0s 977us/step - loss: 1.6812
16/16 [==============================] - 0s 1ms/step - loss: 1.6812
16/16 [==============================] - 0s 1ms/step - loss: 1.6812
16/16 [==============================] - 0s 1ms/step - loss: 1.6812
16/16 [==============================] - 0s 1ms/step - loss: 1.6812
Epoch 33 of 60

Testing for epoch 33 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4773
16/16 [==============================] - 0s 634us/step - loss: 1.5951
16/16 [==============================] - 0s 1ms/step - loss: 1.6703
16/16 [==============================] - 0s 599us/step - loss: 1.6803
16/16 [==============================] - 0s 685us/step - loss: 1.6830
16/16 [==============================] - 0s 617us/step - loss: 1.6833
16/16 [==============================] - 0s 945us/step - loss: 1.6833
16/16 [==============================] - 0s 1ms/step - loss: 1.6833
16/16 [==============================] - 0s 1ms/step - loss: 1.6833
16/16 [==============================] - 0s 602us/step - loss: 1.6832

Testing for epoch 33 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.4855
16/16 [==============================] - 0s 1ms/step - loss: 1.6287
16/16 [==============================] - 0s 1ms/step - loss: 1.7034
16/16 [==============================] - 0s 1ms/step - loss: 1.7137
16/16 [==============================] - 0s 639us/step - loss: 1.7163
16/16 [==============================] - 0s 681us/step - loss: 1.7166
16/16 [==============================] - 0s 620us/step - loss: 1.7167
16/16 [==============================] - 0s 583us/step - loss: 1.7167
16/16 [==============================] - 0s 1ms/step - loss: 1.7167
16/16 [==============================] - 0s 1ms/step - loss: 1.7166
Epoch 34 of 60

Testing for epoch 34 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.4900
16/16 [==============================] - 0s 773us/step - loss: 1.6487
16/16 [==============================] - 0s 624us/step - loss: 1.7219
16/16 [==============================] - 0s 1ms/step - loss: 1.7322
16/16 [==============================] - 0s 1ms/step - loss: 1.7348
16/16 [==============================] - 0s 1ms/step - loss: 1.7352
16/16 [==============================] - 0s 1ms/step - loss: 1.7352
16/16 [==============================] - 0s 1ms/step - loss: 1.7352
16/16 [==============================] - 0s 1ms/step - loss: 1.7352
16/16 [==============================] - 0s 1ms/step - loss: 1.7351

Testing for epoch 34 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.5048
16/16 [==============================] - 0s 1ms/step - loss: 1.6447
16/16 [==============================] - 0s 1ms/step - loss: 1.7129
16/16 [==============================] - 0s 1ms/step - loss: 1.7226
16/16 [==============================] - 0s 1ms/step - loss: 1.7250
16/16 [==============================] - 0s 1ms/step - loss: 1.7253
16/16 [==============================] - 0s 717us/step - loss: 1.7253
16/16 [==============================] - 0s 830us/step - loss: 1.7253
16/16 [==============================] - 0s 624us/step - loss: 1.7253
16/16 [==============================] - 0s 682us/step - loss: 1.7252
Epoch 35 of 60

Testing for epoch 35 index 1:
16/16 [==============================] - 0s 648us/step - loss: 0.5151
16/16 [==============================] - 0s 1ms/step - loss: 1.6720
16/16 [==============================] - 0s 838us/step - loss: 1.7389
16/16 [==============================] - 0s 1ms/step - loss: 1.7487
16/16 [==============================] - 0s 1ms/step - loss: 1.7510
16/16 [==============================] - 0s 832us/step - loss: 1.7513
16/16 [==============================] - 0s 1ms/step - loss: 1.7514
16/16 [==============================] - 0s 595us/step - loss: 1.7514
16/16 [==============================] - 0s 1ms/step - loss: 1.7514
16/16 [==============================] - 0s 639us/step - loss: 1.7513

Testing for epoch 35 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.5348
16/16 [==============================] - 0s 870us/step - loss: 1.6661
16/16 [==============================] - 0s 1ms/step - loss: 1.7277
16/16 [==============================] - 0s 640us/step - loss: 1.7367
16/16 [==============================] - 0s 897us/step - loss: 1.7389
16/16 [==============================] - 0s 1ms/step - loss: 1.7391
16/16 [==============================] - 0s 1ms/step - loss: 1.7392
16/16 [==============================] - 0s 1ms/step - loss: 1.7392
16/16 [==============================] - 0s 745us/step - loss: 1.7392
16/16 [==============================] - 0s 1ms/step - loss: 1.7391
Epoch 36 of 60

Testing for epoch 36 index 1:
16/16 [==============================] - 0s 688us/step - loss: 0.5491
16/16 [==============================] - 0s 635us/step - loss: 1.6837
16/16 [==============================] - 0s 601us/step - loss: 1.7423
16/16 [==============================] - 0s 601us/step - loss: 1.7511
16/16 [==============================] - 0s 1ms/step - loss: 1.7531
16/16 [==============================] - 0s 656us/step - loss: 1.7534
16/16 [==============================] - 0s 1ms/step - loss: 1.7534
16/16 [==============================] - 0s 1ms/step - loss: 1.7534
16/16 [==============================] - 0s 1ms/step - loss: 1.7534
16/16 [==============================] - 0s 1ms/step - loss: 1.7534

Testing for epoch 36 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.5738
16/16 [==============================] - 0s 1ms/step - loss: 1.6942
16/16 [==============================] - 0s 1ms/step - loss: 1.7482
16/16 [==============================] - 0s 1ms/step - loss: 1.7566
16/16 [==============================] - 0s 623us/step - loss: 1.7585
16/16 [==============================] - 0s 741us/step - loss: 1.7588
16/16 [==============================] - 0s 774us/step - loss: 1.7588
16/16 [==============================] - 0s 1ms/step - loss: 1.7588
16/16 [==============================] - 0s 1ms/step - loss: 1.7588
16/16 [==============================] - 0s 1ms/step - loss: 1.7587
Epoch 37 of 60

Testing for epoch 37 index 1:
16/16 [==============================] - 0s 604us/step - loss: 0.5910
16/16 [==============================] - 0s 1ms/step - loss: 1.7056
16/16 [==============================] - 0s 1ms/step - loss: 1.7570
16/16 [==============================] - 0s 1ms/step - loss: 1.7652
16/16 [==============================] - 0s 596us/step - loss: 1.7670
16/16 [==============================] - 0s 944us/step - loss: 1.7673
16/16 [==============================] - 0s 1ms/step - loss: 1.7673
16/16 [==============================] - 0s 619us/step - loss: 1.7673
16/16 [==============================] - 0s 617us/step - loss: 1.7673
16/16 [==============================] - 0s 1ms/step - loss: 1.7673

Testing for epoch 37 index 2:
16/16 [==============================] - 0s 648us/step - loss: 0.6175
16/16 [==============================] - 0s 628us/step - loss: 1.7136
16/16 [==============================] - 0s 666us/step - loss: 1.7615
16/16 [==============================] - 0s 612us/step - loss: 1.7696
16/16 [==============================] - 0s 1ms/step - loss: 1.7713
16/16 [==============================] - 0s 742us/step - loss: 1.7715
16/16 [==============================] - 0s 626us/step - loss: 1.7716
16/16 [==============================] - 0s 614us/step - loss: 1.7716
16/16 [==============================] - 0s 623us/step - loss: 1.7715
16/16 [==============================] - 0s 932us/step - loss: 1.7715
Epoch 38 of 60

Testing for epoch 38 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.6365
16/16 [==============================] - 0s 1ms/step - loss: 1.7285
16/16 [==============================] - 0s 1ms/step - loss: 1.7737
16/16 [==============================] - 0s 1ms/step - loss: 1.7815
16/16 [==============================] - 0s 1ms/step - loss: 1.7831
16/16 [==============================] - 0s 617us/step - loss: 1.7834
16/16 [==============================] - 0s 1ms/step - loss: 1.7834
16/16 [==============================] - 0s 1ms/step - loss: 1.7834
16/16 [==============================] - 0s 601us/step - loss: 1.7834
16/16 [==============================] - 0s 929us/step - loss: 1.7834

Testing for epoch 38 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.6645
16/16 [==============================] - 0s 1ms/step - loss: 1.7425
16/16 [==============================] - 0s 1ms/step - loss: 1.7848
16/16 [==============================] - 0s 641us/step - loss: 1.7924
16/16 [==============================] - 0s 1ms/step - loss: 1.7938
16/16 [==============================] - 0s 1ms/step - loss: 1.7941
16/16 [==============================] - 0s 821us/step - loss: 1.7941
16/16 [==============================] - 0s 1ms/step - loss: 1.7941
16/16 [==============================] - 0s 626us/step - loss: 1.7941
16/16 [==============================] - 0s 636us/step - loss: 1.7941
Epoch 39 of 60

Testing for epoch 39 index 1:
16/16 [==============================] - 0s 634us/step - loss: 0.6840
16/16 [==============================] - 0s 759us/step - loss: 1.7590
16/16 [==============================] - 0s 1ms/step - loss: 1.7997
16/16 [==============================] - 0s 1ms/step - loss: 1.8070
16/16 [==============================] - 0s 1ms/step - loss: 1.8084
16/16 [==============================] - 0s 1ms/step - loss: 1.8086
16/16 [==============================] - 0s 639us/step - loss: 1.8086
16/16 [==============================] - 0s 621us/step - loss: 1.8086
16/16 [==============================] - 0s 670us/step - loss: 1.8086
16/16 [==============================] - 0s 1ms/step - loss: 1.8086

Testing for epoch 39 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.7124
16/16 [==============================] - 0s 999us/step - loss: 1.7783
16/16 [==============================] - 0s 1ms/step - loss: 1.8175
16/16 [==============================] - 0s 688us/step - loss: 1.8245
16/16 [==============================] - 0s 1ms/step - loss: 1.8258
16/16 [==============================] - 0s 1ms/step - loss: 1.8261
16/16 [==============================] - 0s 716us/step - loss: 1.8261
16/16 [==============================] - 0s 658us/step - loss: 1.8261
16/16 [==============================] - 0s 632us/step - loss: 1.8261
16/16 [==============================] - 0s 635us/step - loss: 1.8261
Epoch 40 of 60

Testing for epoch 40 index 1:
16/16 [==============================] - 0s 921us/step - loss: 0.7273
16/16 [==============================] - 0s 863us/step - loss: 1.7767
16/16 [==============================] - 0s 995us/step - loss: 1.8143
16/16 [==============================] - 0s 593us/step - loss: 1.8210
16/16 [==============================] - 0s 1ms/step - loss: 1.8223
16/16 [==============================] - 0s 877us/step - loss: 1.8225
16/16 [==============================] - 0s 1ms/step - loss: 1.8226
16/16 [==============================] - 0s 820us/step - loss: 1.8226
16/16 [==============================] - 0s 1ms/step - loss: 1.8225
16/16 [==============================] - 0s 1ms/step - loss: 1.8225

Testing for epoch 40 index 2:
16/16 [==============================] - 0s 688us/step - loss: 0.7514
16/16 [==============================] - 0s 1ms/step - loss: 1.7804
16/16 [==============================] - 0s 1ms/step - loss: 1.8152
16/16 [==============================] - 0s 585us/step - loss: 1.8214
16/16 [==============================] - 0s 1ms/step - loss: 1.8225
16/16 [==============================] - 0s 619us/step - loss: 1.8227
16/16 [==============================] - 0s 1ms/step - loss: 1.8228
16/16 [==============================] - 0s 1ms/step - loss: 1.8228
16/16 [==============================] - 0s 1ms/step - loss: 1.8227
16/16 [==============================] - 0s 852us/step - loss: 1.8227
Epoch 41 of 60

Testing for epoch 41 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.7649
16/16 [==============================] - 0s 1ms/step - loss: 1.7944
16/16 [==============================] - 0s 1ms/step - loss: 1.8299
16/16 [==============================] - 0s 804us/step - loss: 1.8361
16/16 [==============================] - 0s 1ms/step - loss: 1.8372
16/16 [==============================] - 0s 612us/step - loss: 1.8375
16/16 [==============================] - 0s 1ms/step - loss: 1.8375
16/16 [==============================] - 0s 1ms/step - loss: 1.8375
16/16 [==============================] - 0s 1ms/step - loss: 1.8375
16/16 [==============================] - 0s 641us/step - loss: 1.8375

Testing for epoch 41 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.7882
16/16 [==============================] - 0s 853us/step - loss: 1.8148
16/16 [==============================] - 0s 659us/step - loss: 1.8491
16/16 [==============================] - 0s 615us/step - loss: 1.8553
16/16 [==============================] - 0s 931us/step - loss: 1.8563
16/16 [==============================] - 0s 1ms/step - loss: 1.8566
16/16 [==============================] - 0s 634us/step - loss: 1.8566
16/16 [==============================] - 0s 861us/step - loss: 1.8566
16/16 [==============================] - 0s 960us/step - loss: 1.8566
16/16 [==============================] - 0s 1ms/step - loss: 1.8566
Epoch 42 of 60

Testing for epoch 42 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.7975
16/16 [==============================] - 0s 646us/step - loss: 1.8225
16/16 [==============================] - 0s 1ms/step - loss: 1.8555
16/16 [==============================] - 0s 588us/step - loss: 1.8616
16/16 [==============================] - 0s 898us/step - loss: 1.8626
16/16 [==============================] - 0s 1ms/step - loss: 1.8628
16/16 [==============================] - 0s 1ms/step - loss: 1.8628
16/16 [==============================] - 0s 1ms/step - loss: 1.8628
16/16 [==============================] - 0s 661us/step - loss: 1.8628
16/16 [==============================] - 0s 636us/step - loss: 1.8628

Testing for epoch 42 index 2:
16/16 [==============================] - 0s 590us/step - loss: 0.8169
16/16 [==============================] - 0s 1ms/step - loss: 1.8391
16/16 [==============================] - 0s 633us/step - loss: 1.8715
16/16 [==============================] - 0s 585us/step - loss: 1.8774
16/16 [==============================] - 0s 615us/step - loss: 1.8784
16/16 [==============================] - 0s 596us/step - loss: 1.8786
16/16 [==============================] - 0s 1ms/step - loss: 1.8787
16/16 [==============================] - 0s 1ms/step - loss: 1.8787
16/16 [==============================] - 0s 631us/step - loss: 1.8787
16/16 [==============================] - 0s 671us/step - loss: 1.8787
Epoch 43 of 60

Testing for epoch 43 index 1:
16/16 [==============================] - 0s 865us/step - loss: 0.8231
16/16 [==============================] - 0s 1ms/step - loss: 1.8496
16/16 [==============================] - 0s 620us/step - loss: 1.8823
16/16 [==============================] - 0s 664us/step - loss: 1.8883
16/16 [==============================] - 0s 600us/step - loss: 1.8893
16/16 [==============================] - 0s 1ms/step - loss: 1.8895
16/16 [==============================] - 0s 1ms/step - loss: 1.8896
16/16 [==============================] - 0s 1ms/step - loss: 1.8896
16/16 [==============================] - 0s 628us/step - loss: 1.8896
16/16 [==============================] - 0s 1ms/step - loss: 1.8895

Testing for epoch 43 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.8391
16/16 [==============================] - 0s 609us/step - loss: 1.8681
16/16 [==============================] - 0s 871us/step - loss: 1.9009
16/16 [==============================] - 0s 565us/step - loss: 1.9070
16/16 [==============================] - 0s 1ms/step - loss: 1.9079
16/16 [==============================] - 0s 610us/step - loss: 1.9081
16/16 [==============================] - 0s 637us/step - loss: 1.9082
16/16 [==============================] - 0s 1ms/step - loss: 1.9082
16/16 [==============================] - 0s 1ms/step - loss: 1.9082
16/16 [==============================] - 0s 880us/step - loss: 1.9082
Epoch 44 of 60

Testing for epoch 44 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.8437
16/16 [==============================] - 0s 1ms/step - loss: 1.8798
16/16 [==============================] - 0s 923us/step - loss: 1.9120
16/16 [==============================] - 0s 1ms/step - loss: 1.9179
16/16 [==============================] - 0s 612us/step - loss: 1.9189
16/16 [==============================] - 0s 1ms/step - loss: 1.9191
16/16 [==============================] - 0s 681us/step - loss: 1.9191
16/16 [==============================] - 0s 1ms/step - loss: 1.9191
16/16 [==============================] - 0s 1ms/step - loss: 1.9191
16/16 [==============================] - 0s 1ms/step - loss: 1.9191

Testing for epoch 44 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.8544
16/16 [==============================] - 0s 645us/step - loss: 1.8871
16/16 [==============================] - 0s 632us/step - loss: 1.9189
16/16 [==============================] - 0s 1ms/step - loss: 1.9248
16/16 [==============================] - 0s 1ms/step - loss: 1.9257
16/16 [==============================] - 0s 1ms/step - loss: 1.9259
16/16 [==============================] - 0s 836us/step - loss: 1.9259
16/16 [==============================] - 0s 695us/step - loss: 1.9259
16/16 [==============================] - 0s 1ms/step - loss: 1.9259
16/16 [==============================] - 0s 808us/step - loss: 1.9259
Epoch 45 of 60

Testing for epoch 45 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.8583
16/16 [==============================] - 0s 1ms/step - loss: 1.9099
16/16 [==============================] - 0s 785us/step - loss: 1.9431
16/16 [==============================] - 0s 782us/step - loss: 1.9491
16/16 [==============================] - 0s 1ms/step - loss: 1.9501
16/16 [==============================] - 0s 711us/step - loss: 1.9503
16/16 [==============================] - 0s 617us/step - loss: 1.9503
16/16 [==============================] - 0s 601us/step - loss: 1.9503
16/16 [==============================] - 0s 671us/step - loss: 1.9503
16/16 [==============================] - 0s 602us/step - loss: 1.9504

Testing for epoch 45 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.8705
16/16 [==============================] - 0s 1ms/step - loss: 1.9270
16/16 [==============================] - 0s 928us/step - loss: 1.9599
16/16 [==============================] - 0s 758us/step - loss: 1.9658
16/16 [==============================] - 0s 2ms/step - loss: 1.9668
16/16 [==============================] - 0s 1ms/step - loss: 1.9670
16/16 [==============================] - 0s 594us/step - loss: 1.9670
16/16 [==============================] - 0s 600us/step - loss: 1.9670
16/16 [==============================] - 0s 599us/step - loss: 1.9670
16/16 [==============================] - 0s 924us/step - loss: 1.9670
Epoch 46 of 60

Testing for epoch 46 index 1:
16/16 [==============================] - 0s 643us/step - loss: 0.8683
16/16 [==============================] - 0s 1ms/step - loss: 1.9287
16/16 [==============================] - 0s 665us/step - loss: 1.9614
16/16 [==============================] - 0s 1ms/step - loss: 1.9673
16/16 [==============================] - 0s 1ms/step - loss: 1.9683
16/16 [==============================] - 0s 1ms/step - loss: 1.9685
16/16 [==============================] - 0s 654us/step - loss: 1.9685
16/16 [==============================] - 0s 762us/step - loss: 1.9685
16/16 [==============================] - 0s 628us/step - loss: 1.9685
16/16 [==============================] - 0s 654us/step - loss: 1.9685

Testing for epoch 46 index 2:
16/16 [==============================] - 0s 659us/step - loss: 0.8815
16/16 [==============================] - 0s 1ms/step - loss: 1.9514
16/16 [==============================] - 0s 1ms/step - loss: 1.9846
16/16 [==============================] - 0s 1ms/step - loss: 1.9905
16/16 [==============================] - 0s 1ms/step - loss: 1.9915
16/16 [==============================] - 0s 786us/step - loss: 1.9916
16/16 [==============================] - 0s 655us/step - loss: 1.9917
16/16 [==============================] - 0s 1ms/step - loss: 1.9917
16/16 [==============================] - 0s 973us/step - loss: 1.9917
16/16 [==============================] - 0s 1ms/step - loss: 1.9917
Epoch 47 of 60

Testing for epoch 47 index 1:
16/16 [==============================] - 0s 741us/step - loss: 0.8773
16/16 [==============================] - 0s 672us/step - loss: 1.9488
16/16 [==============================] - 0s 660us/step - loss: 1.9816
16/16 [==============================] - 0s 1ms/step - loss: 1.9875
16/16 [==============================] - 0s 899us/step - loss: 1.9885
16/16 [==============================] - 0s 1ms/step - loss: 1.9887
16/16 [==============================] - 0s 885us/step - loss: 1.9887
16/16 [==============================] - 0s 661us/step - loss: 1.9887
16/16 [==============================] - 0s 1ms/step - loss: 1.9887
16/16 [==============================] - 0s 972us/step - loss: 1.9887

Testing for epoch 47 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 0.8923
16/16 [==============================] - 0s 802us/step - loss: 1.9764
16/16 [==============================] - 0s 733us/step - loss: 2.0094
16/16 [==============================] - 0s 878us/step - loss: 2.0152
16/16 [==============================] - 0s 667us/step - loss: 2.0162
16/16 [==============================] - 0s 1ms/step - loss: 2.0164
16/16 [==============================] - 0s 831us/step - loss: 2.0164
16/16 [==============================] - 0s 1ms/step - loss: 2.0164
16/16 [==============================] - 0s 1ms/step - loss: 2.0164
16/16 [==============================] - 0s 1ms/step - loss: 2.0165
Epoch 48 of 60

Testing for epoch 48 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.8980
16/16 [==============================] - 0s 829us/step - loss: 2.0059
16/16 [==============================] - 0s 1ms/step - loss: 2.0403
16/16 [==============================] - 0s 1ms/step - loss: 2.0464
16/16 [==============================] - 0s 991us/step - loss: 2.0474
16/16 [==============================] - 0s 657us/step - loss: 2.0476
16/16 [==============================] - 0s 1ms/step - loss: 2.0476
16/16 [==============================] - 0s 1ms/step - loss: 2.0476
16/16 [==============================] - 0s 625us/step - loss: 2.0476
16/16 [==============================] - 0s 1ms/step - loss: 2.0476

Testing for epoch 48 index 2:
16/16 [==============================] - 0s 640us/step - loss: 0.9077
16/16 [==============================] - 0s 1ms/step - loss: 2.0130
16/16 [==============================] - 0s 1ms/step - loss: 2.0470
16/16 [==============================] - 0s 953us/step - loss: 2.0530
16/16 [==============================] - 0s 1ms/step - loss: 2.0539
16/16 [==============================] - 0s 1ms/step - loss: 2.0541
16/16 [==============================] - 0s 1ms/step - loss: 2.0542
16/16 [==============================] - 0s 1ms/step - loss: 2.0542
16/16 [==============================] - 0s 1ms/step - loss: 2.0542
16/16 [==============================] - 0s 1ms/step - loss: 2.0542
Epoch 49 of 60

Testing for epoch 49 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.9081
16/16 [==============================] - 0s 1ms/step - loss: 2.0204
16/16 [==============================] - 0s 1ms/step - loss: 2.0543
16/16 [==============================] - 0s 694us/step - loss: 2.0602
16/16 [==============================] - 0s 1ms/step - loss: 2.0611
16/16 [==============================] - 0s 1ms/step - loss: 2.0613
16/16 [==============================] - 0s 815us/step - loss: 2.0614
16/16 [==============================] - 0s 1ms/step - loss: 2.0614
16/16 [==============================] - 0s 804us/step - loss: 2.0614
16/16 [==============================] - 0s 1ms/step - loss: 2.0614

Testing for epoch 49 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.9192
16/16 [==============================] - 0s 2ms/step - loss: 2.0292
16/16 [==============================] - 0s 1ms/step - loss: 2.0625
16/16 [==============================] - 0s 1ms/step - loss: 2.0683
16/16 [==============================] - 0s 1ms/step - loss: 2.0692
16/16 [==============================] - 0s 1ms/step - loss: 2.0693
16/16 [==============================] - 0s 1ms/step - loss: 2.0694
16/16 [==============================] - 0s 1ms/step - loss: 2.0694
16/16 [==============================] - 0s 1ms/step - loss: 2.0694
16/16 [==============================] - 0s 1ms/step - loss: 2.0694
Epoch 50 of 60

Testing for epoch 50 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.9220
16/16 [==============================] - 0s 1ms/step - loss: 2.0413
16/16 [==============================] - 0s 1ms/step - loss: 2.0749
16/16 [==============================] - 0s 1ms/step - loss: 2.0807
16/16 [==============================] - 0s 1ms/step - loss: 2.0816
16/16 [==============================] - 0s 1ms/step - loss: 2.0818
16/16 [==============================] - 0s 1ms/step - loss: 2.0819
16/16 [==============================] - 0s 1ms/step - loss: 2.0819
16/16 [==============================] - 0s 1ms/step - loss: 2.0819
16/16 [==============================] - 0s 1ms/step - loss: 2.0819

Testing for epoch 50 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 0.9344
16/16 [==============================] - 0s 2ms/step - loss: 2.0501
16/16 [==============================] - 0s 2ms/step - loss: 2.0831
16/16 [==============================] - 0s 2ms/step - loss: 2.0889
16/16 [==============================] - 0s 2ms/step - loss: 2.0898
16/16 [==============================] - 0s 2ms/step - loss: 2.0900
16/16 [==============================] - 0s 2ms/step - loss: 2.0900
16/16 [==============================] - 0s 2ms/step - loss: 2.0900
16/16 [==============================] - 0s 2ms/step - loss: 2.0900
16/16 [==============================] - 0s 2ms/step - loss: 2.0900
Epoch 51 of 60

Testing for epoch 51 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 0.9430
16/16 [==============================] - 0s 2ms/step - loss: 2.0784
16/16 [==============================] - 0s 1ms/step - loss: 2.1121
16/16 [==============================] - 0s 1ms/step - loss: 2.1180
16/16 [==============================] - 0s 1ms/step - loss: 2.1189
16/16 [==============================] - 0s 670us/step - loss: 2.1191
16/16 [==============================] - 0s 707us/step - loss: 2.1191
16/16 [==============================] - 0s 720us/step - loss: 2.1191
16/16 [==============================] - 0s 685us/step - loss: 2.1191
16/16 [==============================] - 0s 600us/step - loss: 2.1191

Testing for epoch 51 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.9590
16/16 [==============================] - 0s 1ms/step - loss: 2.0944
16/16 [==============================] - 0s 2ms/step - loss: 2.1283
16/16 [==============================] - 0s 1ms/step - loss: 2.1342
16/16 [==============================] - 0s 2ms/step - loss: 2.1351
16/16 [==============================] - 0s 2ms/step - loss: 2.1353
16/16 [==============================] - 0s 2ms/step - loss: 2.1353
16/16 [==============================] - 0s 1ms/step - loss: 2.1353
16/16 [==============================] - 0s 1ms/step - loss: 2.1353
16/16 [==============================] - 0s 1ms/step - loss: 2.1354
Epoch 52 of 60

Testing for epoch 52 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.9632
16/16 [==============================] - 0s 1ms/step - loss: 2.1018
16/16 [==============================] - 0s 1ms/step - loss: 2.1355
16/16 [==============================] - 0s 1ms/step - loss: 2.1415
16/16 [==============================] - 0s 1ms/step - loss: 2.1424
16/16 [==============================] - 0s 1ms/step - loss: 2.1426
16/16 [==============================] - 0s 1ms/step - loss: 2.1426
16/16 [==============================] - 0s 2ms/step - loss: 2.1426
16/16 [==============================] - 0s 1ms/step - loss: 2.1426
16/16 [==============================] - 0s 1ms/step - loss: 2.1427

Testing for epoch 52 index 2:
16/16 [==============================] - 0s 593us/step - loss: 0.9811
16/16 [==============================] - 0s 1ms/step - loss: 2.1158
16/16 [==============================] - 0s 601us/step - loss: 2.1494
16/16 [==============================] - 0s 604us/step - loss: 2.1553
16/16 [==============================] - 0s 1ms/step - loss: 2.1562
16/16 [==============================] - 0s 580us/step - loss: 2.1564
16/16 [==============================] - 0s 606us/step - loss: 2.1564
16/16 [==============================] - 0s 669us/step - loss: 2.1565
16/16 [==============================] - 0s 933us/step - loss: 2.1565
16/16 [==============================] - 0s 604us/step - loss: 2.1565
Epoch 53 of 60

Testing for epoch 53 index 1:
16/16 [==============================] - 0s 617us/step - loss: 0.9849
16/16 [==============================] - 0s 874us/step - loss: 2.1127
16/16 [==============================] - 0s 601us/step - loss: 2.1443
16/16 [==============================] - 0s 721us/step - loss: 2.1500
16/16 [==============================] - 0s 709us/step - loss: 2.1508
16/16 [==============================] - 0s 636us/step - loss: 2.1510
16/16 [==============================] - 0s 641us/step - loss: 2.1510
16/16 [==============================] - 0s 3ms/step - loss: 2.1510
16/16 [==============================] - 0s 832us/step - loss: 2.1510
16/16 [==============================] - 0s 943us/step - loss: 2.1511

Testing for epoch 53 index 2:
16/16 [==============================] - 0s 960us/step - loss: 1.0029
16/16 [==============================] - 0s 847us/step - loss: 2.1223
16/16 [==============================] - 0s 1ms/step - loss: 2.1535
16/16 [==============================] - 0s 663us/step - loss: 2.1592
16/16 [==============================] - 0s 1ms/step - loss: 2.1600
16/16 [==============================] - 0s 1ms/step - loss: 2.1601
16/16 [==============================] - 0s 1ms/step - loss: 2.1602
16/16 [==============================] - 0s 1ms/step - loss: 2.1602
16/16 [==============================] - 0s 1ms/step - loss: 2.1602
16/16 [==============================] - 0s 1ms/step - loss: 2.1602
Epoch 54 of 60

Testing for epoch 54 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.0201
16/16 [==============================] - 0s 2ms/step - loss: 2.1555
16/16 [==============================] - 0s 698us/step - loss: 2.1869
16/16 [==============================] - 0s 738us/step - loss: 2.1925
16/16 [==============================] - 0s 974us/step - loss: 2.1933
16/16 [==============================] - 0s 1ms/step - loss: 2.1935
16/16 [==============================] - 0s 811us/step - loss: 2.1935
16/16 [==============================] - 0s 1ms/step - loss: 2.1935
16/16 [==============================] - 0s 1ms/step - loss: 2.1935
16/16 [==============================] - 0s 685us/step - loss: 2.1935

Testing for epoch 54 index 2:
16/16 [==============================] - 0s 644us/step - loss: 1.0391
16/16 [==============================] - 0s 1ms/step - loss: 2.1625
16/16 [==============================] - 0s 1ms/step - loss: 2.1931
16/16 [==============================] - 0s 894us/step - loss: 2.1987
16/16 [==============================] - 0s 2ms/step - loss: 2.1995
16/16 [==============================] - 0s 700us/step - loss: 2.1996
16/16 [==============================] - 0s 1ms/step - loss: 2.1997
16/16 [==============================] - 0s 851us/step - loss: 2.1997
16/16 [==============================] - 0s 925us/step - loss: 2.1997
16/16 [==============================] - 0s 868us/step - loss: 2.1997
Epoch 55 of 60

Testing for epoch 55 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 1.0520
16/16 [==============================] - 0s 627us/step - loss: 2.1801
16/16 [==============================] - 0s 1ms/step - loss: 2.2107
16/16 [==============================] - 0s 633us/step - loss: 2.2163
16/16 [==============================] - 0s 899us/step - loss: 2.2171
16/16 [==============================] - 0s 711us/step - loss: 2.2172
16/16 [==============================] - 0s 1ms/step - loss: 2.2173
16/16 [==============================] - 0s 664us/step - loss: 2.2173
16/16 [==============================] - 0s 1ms/step - loss: 2.2173
16/16 [==============================] - 0s 1ms/step - loss: 2.2173

Testing for epoch 55 index 2:
16/16 [==============================] - 0s 589us/step - loss: 1.0727
16/16 [==============================] - 0s 603us/step - loss: 2.1879
16/16 [==============================] - 0s 581us/step - loss: 2.2176
16/16 [==============================] - 0s 580us/step - loss: 2.2229
16/16 [==============================] - 0s 582us/step - loss: 2.2236
16/16 [==============================] - 0s 571us/step - loss: 2.2238
16/16 [==============================] - 0s 574us/step - loss: 2.2238
16/16 [==============================] - 0s 561us/step - loss: 2.2238
16/16 [==============================] - 0s 506us/step - loss: 2.2238
16/16 [==============================] - 0s 526us/step - loss: 2.2239
Epoch 56 of 60

Testing for epoch 56 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 1.0790
16/16 [==============================] - 0s 1ms/step - loss: 2.1883
16/16 [==============================] - 0s 2ms/step - loss: 2.2177
16/16 [==============================] - 0s 2ms/step - loss: 2.2230
16/16 [==============================] - 0s 2ms/step - loss: 2.2237
16/16 [==============================] - 0s 2ms/step - loss: 2.2239
16/16 [==============================] - 0s 2ms/step - loss: 2.2239
16/16 [==============================] - 0s 2ms/step - loss: 2.2239
16/16 [==============================] - 0s 2ms/step - loss: 2.2240
16/16 [==============================] - 0s 2ms/step - loss: 2.2240

Testing for epoch 56 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 1.1019
16/16 [==============================] - 0s 2ms/step - loss: 2.2025
16/16 [==============================] - 0s 2ms/step - loss: 2.2310
16/16 [==============================] - 0s 2ms/step - loss: 2.2362
16/16 [==============================] - 0s 2ms/step - loss: 2.2369
16/16 [==============================] - 0s 2ms/step - loss: 2.2371
16/16 [==============================] - 0s 2ms/step - loss: 2.2371
16/16 [==============================] - 0s 2ms/step - loss: 2.2371
16/16 [==============================] - 0s 2ms/step - loss: 2.2371
16/16 [==============================] - 0s 2ms/step - loss: 2.2372
Epoch 57 of 60

Testing for epoch 57 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 1.1130
16/16 [==============================] - 0s 2ms/step - loss: 2.2126
16/16 [==============================] - 0s 2ms/step - loss: 2.2408
16/16 [==============================] - 0s 2ms/step - loss: 2.2460
16/16 [==============================] - 0s 2ms/step - loss: 2.2466
16/16 [==============================] - 0s 2ms/step - loss: 2.2468
16/16 [==============================] - 0s 2ms/step - loss: 2.2468
16/16 [==============================] - 0s 2ms/step - loss: 2.2469
16/16 [==============================] - 0s 2ms/step - loss: 2.2469
16/16 [==============================] - 0s 2ms/step - loss: 2.2469

Testing for epoch 57 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 1.1360
16/16 [==============================] - 0s 2ms/step - loss: 2.2253
16/16 [==============================] - 0s 2ms/step - loss: 2.2519
16/16 [==============================] - 0s 2ms/step - loss: 2.2569
16/16 [==============================] - 0s 2ms/step - loss: 2.2576
16/16 [==============================] - 0s 2ms/step - loss: 2.2577
16/16 [==============================] - 0s 2ms/step - loss: 2.2577
16/16 [==============================] - 0s 2ms/step - loss: 2.2577
16/16 [==============================] - 0s 2ms/step - loss: 2.2578
16/16 [==============================] - 0s 1ms/step - loss: 2.2578
Epoch 58 of 60

Testing for epoch 58 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.1524
16/16 [==============================] - 0s 2ms/step - loss: 2.2520
16/16 [==============================] - 0s 1ms/step - loss: 2.2798
16/16 [==============================] - 0s 2ms/step - loss: 2.2850
16/16 [==============================] - 0s 2ms/step - loss: 2.2857
16/16 [==============================] - 0s 1ms/step - loss: 2.2858
16/16 [==============================] - 0s 2ms/step - loss: 2.2859
16/16 [==============================] - 0s 966us/step - loss: 2.2859
16/16 [==============================] - 0s 2ms/step - loss: 2.2859
16/16 [==============================] - 0s 2ms/step - loss: 2.2859

Testing for epoch 58 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 1.1690
16/16 [==============================] - 0s 984us/step - loss: 2.2519
16/16 [==============================] - 0s 2ms/step - loss: 2.2784
16/16 [==============================] - 0s 2ms/step - loss: 2.2834
16/16 [==============================] - 0s 925us/step - loss: 2.2840
16/16 [==============================] - 0s 2ms/step - loss: 2.2842
16/16 [==============================] - 0s 2ms/step - loss: 2.2842
16/16 [==============================] - 0s 2ms/step - loss: 2.2842
16/16 [==============================] - 0s 767us/step - loss: 2.2842
16/16 [==============================] - 0s 1ms/step - loss: 2.2843
Epoch 59 of 60

Testing for epoch 59 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 1.1811
16/16 [==============================] - 0s 2ms/step - loss: 2.2676
16/16 [==============================] - 0s 2ms/step - loss: 2.2948
16/16 [==============================] - 0s 2ms/step - loss: 2.2999
16/16 [==============================] - 0s 2ms/step - loss: 2.3005
16/16 [==============================] - 0s 2ms/step - loss: 2.3007
16/16 [==============================] - 0s 2ms/step - loss: 2.3008
16/16 [==============================] - 0s 1ms/step - loss: 2.3008
16/16 [==============================] - 0s 657us/step - loss: 2.3008
16/16 [==============================] - 0s 654us/step - loss: 2.3008

Testing for epoch 59 index 2:
16/16 [==============================] - 0s 3ms/step - loss: 1.1986
16/16 [==============================] - 0s 600us/step - loss: 2.2691
16/16 [==============================] - 0s 579us/step - loss: 2.2946
16/16 [==============================] - 0s 2ms/step - loss: 2.2995
16/16 [==============================] - 0s 2ms/step - loss: 2.3001
16/16 [==============================] - 0s 2ms/step - loss: 2.3003
16/16 [==============================] - 0s 2ms/step - loss: 2.3003
16/16 [==============================] - 0s 2ms/step - loss: 2.3003
16/16 [==============================] - 0s 2ms/step - loss: 2.3004
16/16 [==============================] - 0s 2ms/step - loss: 2.3004
Epoch 60 of 60

Testing for epoch 60 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 1.2123
16/16 [==============================] - 0s 2ms/step - loss: 2.2903
16/16 [==============================] - 0s 2ms/step - loss: 2.3163
16/16 [==============================] - 0s 2ms/step - loss: 2.3213
16/16 [==============================] - 0s 2ms/step - loss: 2.3219
16/16 [==============================] - 0s 2ms/step - loss: 2.3221
16/16 [==============================] - 0s 2ms/step - loss: 2.3221
16/16 [==============================] - 0s 2ms/step - loss: 2.3221
16/16 [==============================] - 0s 2ms/step - loss: 2.3221
16/16 [==============================] - 0s 2ms/step - loss: 2.3222

Testing for epoch 60 index 2:
16/16 [==============================] - 0s 795us/step - loss: 1.2301
16/16 [==============================] - 0s 1ms/step - loss: 2.2941
16/16 [==============================] - 0s 597us/step - loss: 2.3188
16/16 [==============================] - 0s 524us/step - loss: 2.3236
16/16 [==============================] - 0s 889us/step - loss: 2.3242
16/16 [==============================] - 0s 675us/step - loss: 2.3243
16/16 [==============================] - 0s 523us/step - loss: 2.3243
16/16 [==============================] - 0s 577us/step - loss: 2.3243
16/16 [==============================] - 0s 531us/step - loss: 2.3243
16/16 [==============================] - 0s 646us/step - loss: 2.3244

outlier_MO_GAAL_one = list(clf.labels_)

outlier_MO_GAAL_one = list(map(lambda x: 1 if x==0  else -1,outlier_MO_GAAL_one))

_conf = Conf_matrx(outlier_true_one,outlier_MO_GAAL_one,tab_orbit)

_conf.conf("MO-GAAL (Liu et al., 2019)")

Accuracy: 0.950
Precision: 0.950
Recall: 1.000
F1 Score: 0.974

thirteen = twelve.append(_conf.tab)

LSCP

detectors = [KNN(), LOF(), OCSVM()]
clf = LSCP(detectors)
clf.fit(_df[['x', 'y','f']])
_df['LSCP_clf'] = clf.labels_

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/pyod/models/lscp.py:382: UserWarning: The number of histogram bins is greater than the number of classifiers, reducing n_bins to n_clf.
  warnings.warn(

outlier_LSCP_one = list(clf.labels_)

outlier_LSCP_one = list(map(lambda x: 1 if x==0  else -1,outlier_LSCP_one))

_conf = Conf_matrx(outlier_true_one,outlier_LSCP_one,tab_orbit)

_conf.conf("LSCP (Zhao et al., 2019)")

Accuracy: 0.948
Precision: 0.999
Recall: 0.946
F1 Score: 0.972

fourteen_orbit = thirteen.append(_conf.tab)

Orbit Result

round(fourteen_orbit,4)

	Accuracy	Precision	Recall	F1
GODE	0.997	0.9969	1.0000	0.9984
LOF (Breunig et al., 2000)	0.886	0.9872	0.8916	0.9369
kNN (Ramaswamy et al., 2000)	0.948	0.9989	0.9463	0.9719
CBLOF (He et al., 2003)	0.918	0.9568	0.9568	0.9568
OCSVM (Sch ̈olkopf et al., 2001)	0.923	0.9877	0.9305	0.9583
MCD (Hardin and Rocke, 2004)	0.866	0.9533	0.9032	0.9276
Feature Bagging (Lazarevic and Kumar, 2005)	0.912	0.9789	0.9274	0.9524
ABOD (Kriegel et al., 2008)	0.988	0.9937	0.9937	0.9937
Isolation Forest (Liu et al., 2008)	0.378	0.9970	0.3463	0.5141
HBOS (Goldstein and Dengel, 2012)	0.881	0.9612	0.9116	0.9357
SOS (Janssens et al., 2012)	0.881	0.9612	0.9116	0.9357
SO-GAAL (Liu et al., 2019)	0.876	0.9589	0.9084	0.9330
MO-GAAL (Liu et al., 2019)	0.950	0.9500	1.0000	0.9744
LSCP (Zhao et al., 2019)	0.948	0.9989	0.9463	0.9719

Bunny

G = graphs.Bunny()
n = G.N

g = filters.Heat(G, tau=75) 

normal = np.random.randn(n)
unif = np.concatenate([np.random.uniform(low=3,high=7,size=60), np.random.uniform(low=-7,high=-3,size=60),np.zeros(n-120)]); np.random.shuffle(unif)
noise = normal + unif
index_of_trueoutlier2 = np.where(unif!=0)

f = np.zeros(n)
f[1000] = -3234
f = g.filter(f, method='chebyshev') 

2022-11-26 07:54:05,353:[WARNING](pygsp.graphs.graph.lmax): The largest eigenvalue G.lmax is not available, we need to estimate it. Explicitly call G.estimate_lmax() or G.compute_fourier_basis() once beforehand to suppress the warning.

G.coords.shape

(2503, 3)

_W = G.W.toarray()
_x = G.coords[:,0]
_y = G.coords[:,1]
_z = -G.coords[:,2]

_df = pd.DataFrame({'x' : _x, 'y' : _y, 'z' : _z, 'fnoise':f+noise,'f' : f, 'noise': noise})

outlier_true_one_2 = unif.copy()

outlier_true_one_2 = list(map(lambda x: -1 if x !=0  else 1,outlier_true_one_2))

X = np.array(_df)[:,:4]

GODE

_BUNNY = BUNNY(_df)

_BUNNY.fit(sd=20,ref=10)

outlier_simul_one = (_BUNNY.df['Residual']**2).tolist()

outlier_simul_one = list(map(lambda x: -1 if x > 10 else 1,outlier_simul_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_simul_one,tab_bunny)

_conf.conf("GODE")

Accuracy: 0.995
Precision: 0.995
Recall: 0.999
F1 Score: 0.997

one = _conf.tab

LOF

clf = LocalOutlierFactor(n_neighbors=2)

_conf = Conf_matrx(outlier_true_one_2,clf.fit_predict(X),tab_bunny)

_conf.conf("LOF (Breunig et al., 2000)")

Accuracy: 0.928
Precision: 0.957
Recall: 0.969
F1 Score: 0.963

two = one.append(_conf.tab)

KNN

clf = KNN()
clf.fit(_df[['x', 'y','fnoise']])
_df['knn_Clf'] = clf.labels_

outlier_KNN_one = list(clf.labels_)

outlier_KNN_one = list(map(lambda x: 1 if x==0  else -1,outlier_KNN_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_KNN_one,tab_bunny)

_conf.conf("kNN (Ramaswamy et al., 2000)")

Accuracy: 0.940
Precision: 0.996
Recall: 0.941
F1 Score: 0.968

three = two.append(_conf.tab)

CBLOF

clf = CBLOF(contamination=0.05,check_estimator=False, random_state=77)
clf.fit(_df[['x', 'y','fnoise']])
_df['CBLOF_Clf'] = clf.labels_

outlier_CBLOF_one = list(clf.labels_)

outlier_CBLOF_one = list(map(lambda x: 1 if x==0  else -1,outlier_CBLOF_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_CBLOF_one,tab_bunny)

_conf.conf("CBLOF (He et al., 2003)")

Accuracy: 0.978
Precision: 0.989
Recall: 0.987
F1 Score: 0.988

four = three.append(_conf.tab)

OCSVM

clf = svm.OneClassSVM(nu=0.1, kernel="rbf", gamma=0.1)

clf.fit(X)

OneClassSVM(gamma=0.1, nu=0.1)

outlier_OSVM_one = list(clf.predict(X))

_conf = Conf_matrx(outlier_true_one_2,outlier_OSVM_one,tab_bunny)

_conf.conf("OCSVM (Sch ̈olkopf et al., 2001)")

Accuracy: 0.932
Precision: 0.991
Recall: 0.937
F1 Score: 0.963

five = four.append(_conf.tab)

MCD

clf = MCD()
clf.fit(_df[['x', 'y','fnoise']])
_df['MCD_clf'] = clf.labels_

outlier_MCD_one = list(clf.labels_)

outlier_MCD_one = list(map(lambda x: 1 if x==0  else -1,outlier_MCD_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_MCD_one,tab_bunny)

_conf.conf("MCD (Hardin and Rocke, 2004)")

Accuracy: 0.935
Precision: 0.993
Recall: 0.938
F1 Score: 0.965

six = five.append(_conf.tab)

Feature Bagging

clf = FeatureBagging()
clf.fit(_df[['x', 'y','fnoise']])
_df['FeatureBagging_clf'] = clf.labels_

outlier_FeatureBagging_one = list(clf.labels_)

outlier_FeatureBagging_one = list(map(lambda x: 1 if x==0  else -1,outlier_FeatureBagging_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_FeatureBagging_one,tab_bunny)

_conf.conf("Feature Bagging (Lazarevic and Kumar, 2005)")

Accuracy: 0.915
Precision: 0.982
Recall: 0.928
F1 Score: 0.954

seven = six.append(_conf.tab)

ABOD

clf = ABOD(contamination=0.05)
clf.fit(_df[['x', 'y','fnoise']])
_df['ABOD_Clf'] = clf.labels_

outlier_ABOD_one = list(clf.labels_)

outlier_ABOD_one = list(map(lambda x: 1 if x==0  else -1,outlier_ABOD_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_ABOD_one,tab_bunny)

_conf.conf("ABOD (Kriegel et al., 2008)")

Accuracy: 0.977
Precision: 0.989
Recall: 0.987
F1 Score: 0.988

eight = seven.append(_conf.tab)

IForest

od = IForest(
    threshold=0.,
    n_estimators=100
)

od.fit(_df[['x', 'y','fnoise']])

preds = od.predict(
    _df[['x', 'y','fnoise']],
    return_instance_score=True
)

_df['IF_alibi'] = preds['data']['is_outlier']

outlier_alibi_one = _df['IF_alibi']

outlier_alibi_one = list(map(lambda x: 1 if x==0  else -1,outlier_alibi_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_alibi_one,tab_bunny)

_conf.conf("Isolation Forest (Liu et al., 2008)")

Accuracy: 0.794
Precision: 0.995
Recall: 0.788
F1 Score: 0.879

nine = eight.append(_conf.tab)

HBOS

clf = HBOS()
clf.fit(_df[['x', 'y','fnoise']])
_df['HBOS_clf'] = clf.labels_

outlier_HBOS_one = list(clf.labels_)

outlier_HBOS_one = list(map(lambda x: 1 if x==0  else -1,outlier_HBOS_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_HBOS_one,tab_bunny)

_conf.conf("HBOS (Goldstein and Dengel, 2012)")

Accuracy: 0.895
Precision: 0.969
Recall: 0.919
F1 Score: 0.944

ten = nine.append(_conf.tab)

SOS

outlier_SOS_one = list(clf.labels_)

outlier_SOS_one = list(map(lambda x: 1 if x==0  else -1,outlier_SOS_one))

clf = SOS()
clf.fit(_df[['x', 'y','fnoise']])
_df['SOS_clf'] = clf.labels_

_conf = Conf_matrx(outlier_true_one_2,outlier_SOS_one,tab_bunny)

_conf.conf("SOS (Janssens et al., 2012)")

Accuracy: 0.895
Precision: 0.969
Recall: 0.919
F1 Score: 0.944

eleven = ten.append(_conf.tab)

SO_GAAL

clf = SO_GAAL()
clf.fit(_df[['x', 'y','fnoise']])
_df['SO_GAAL_clf'] = clf.labels_

Epoch 1 of 60

Testing for epoch 1 index 1:

Testing for epoch 1 index 2:

Testing for epoch 1 index 3:

Testing for epoch 1 index 4:

Testing for epoch 1 index 5:
Epoch 2 of 60

Testing for epoch 2 index 1:

Testing for epoch 2 index 2:

Testing for epoch 2 index 3:

Testing for epoch 2 index 4:

Testing for epoch 2 index 5:
Epoch 3 of 60

Testing for epoch 3 index 1:

Testing for epoch 3 index 2:

Testing for epoch 3 index 3:

Testing for epoch 3 index 4:

Testing for epoch 3 index 5:
Epoch 4 of 60

Testing for epoch 4 index 1:

Testing for epoch 4 index 2:

Testing for epoch 4 index 3:

Testing for epoch 4 index 4:

Testing for epoch 4 index 5:
Epoch 5 of 60

Testing for epoch 5 index 1:

Testing for epoch 5 index 2:

Testing for epoch 5 index 3:

Testing for epoch 5 index 4:

Testing for epoch 5 index 5:
Epoch 6 of 60

Testing for epoch 6 index 1:

Testing for epoch 6 index 2:

Testing for epoch 6 index 3:

Testing for epoch 6 index 4:

Testing for epoch 6 index 5:
Epoch 7 of 60

Testing for epoch 7 index 1:

Testing for epoch 7 index 2:

Testing for epoch 7 index 3:

Testing for epoch 7 index 4:

Testing for epoch 7 index 5:
Epoch 8 of 60

Testing for epoch 8 index 1:

Testing for epoch 8 index 2:

Testing for epoch 8 index 3:

Testing for epoch 8 index 4:

Testing for epoch 8 index 5:
Epoch 9 of 60

Testing for epoch 9 index 1:

Testing for epoch 9 index 2:

Testing for epoch 9 index 3:

Testing for epoch 9 index 4:

Testing for epoch 9 index 5:
Epoch 10 of 60

Testing for epoch 10 index 1:

Testing for epoch 10 index 2:

Testing for epoch 10 index 3:

Testing for epoch 10 index 4:

Testing for epoch 10 index 5:
Epoch 11 of 60

Testing for epoch 11 index 1:

Testing for epoch 11 index 2:

Testing for epoch 11 index 3:

Testing for epoch 11 index 4:

Testing for epoch 11 index 5:
Epoch 12 of 60

Testing for epoch 12 index 1:

Testing for epoch 12 index 2:

Testing for epoch 12 index 3:

Testing for epoch 12 index 4:

Testing for epoch 12 index 5:
Epoch 13 of 60

Testing for epoch 13 index 1:

Testing for epoch 13 index 2:

Testing for epoch 13 index 3:

Testing for epoch 13 index 4:

Testing for epoch 13 index 5:
Epoch 14 of 60

Testing for epoch 14 index 1:

Testing for epoch 14 index 2:

Testing for epoch 14 index 3:

Testing for epoch 14 index 4:

Testing for epoch 14 index 5:
Epoch 15 of 60

Testing for epoch 15 index 1:

Testing for epoch 15 index 2:

Testing for epoch 15 index 3:

Testing for epoch 15 index 4:

Testing for epoch 15 index 5:
Epoch 16 of 60

Testing for epoch 16 index 1:

Testing for epoch 16 index 2:

Testing for epoch 16 index 3:

Testing for epoch 16 index 4:

Testing for epoch 16 index 5:
Epoch 17 of 60

Testing for epoch 17 index 1:

Testing for epoch 17 index 2:

Testing for epoch 17 index 3:

Testing for epoch 17 index 4:

Testing for epoch 17 index 5:
Epoch 18 of 60

Testing for epoch 18 index 1:

Testing for epoch 18 index 2:

Testing for epoch 18 index 3:

Testing for epoch 18 index 4:

Testing for epoch 18 index 5:
Epoch 19 of 60

Testing for epoch 19 index 1:

Testing for epoch 19 index 2:

Testing for epoch 19 index 3:

Testing for epoch 19 index 4:

Testing for epoch 19 index 5:
Epoch 20 of 60

Testing for epoch 20 index 1:

Testing for epoch 20 index 2:

Testing for epoch 20 index 3:

Testing for epoch 20 index 4:

Testing for epoch 20 index 5:
Epoch 21 of 60

Testing for epoch 21 index 1:

Testing for epoch 21 index 2:

Testing for epoch 21 index 3:

Testing for epoch 21 index 4:

Testing for epoch 21 index 5:
Epoch 22 of 60

Testing for epoch 22 index 1:
16/16 [==============================] - 0s 894us/step - loss: 1.8529

Testing for epoch 22 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.8921

Testing for epoch 22 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 1.9309

Testing for epoch 22 index 4:
16/16 [==============================] - 0s 690us/step - loss: 1.8584

Testing for epoch 22 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 1.8820
Epoch 23 of 60

Testing for epoch 23 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.9128

Testing for epoch 23 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 1.9055

Testing for epoch 23 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 1.9463

Testing for epoch 23 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 1.9150

Testing for epoch 23 index 5:
16/16 [==============================] - 0s 755us/step - loss: 1.9138
Epoch 24 of 60

Testing for epoch 24 index 1:
16/16 [==============================] - 0s 636us/step - loss: 2.0252

Testing for epoch 24 index 2:
16/16 [==============================] - 0s 640us/step - loss: 1.9456

Testing for epoch 24 index 3:
16/16 [==============================] - 0s 701us/step - loss: 1.9662

Testing for epoch 24 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 1.9841

Testing for epoch 24 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.0037
Epoch 25 of 60

Testing for epoch 25 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 1.9889

Testing for epoch 25 index 2:
16/16 [==============================] - 0s 871us/step - loss: 1.9856

Testing for epoch 25 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.0014

Testing for epoch 25 index 4:
16/16 [==============================] - 0s 778us/step - loss: 2.0162

Testing for epoch 25 index 5:
16/16 [==============================] - 0s 664us/step - loss: 2.0739
Epoch 26 of 60

Testing for epoch 26 index 1:
16/16 [==============================] - 0s 637us/step - loss: 2.0179

Testing for epoch 26 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.0133

Testing for epoch 26 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.0655

Testing for epoch 26 index 4:
16/16 [==============================] - 0s 637us/step - loss: 2.0657

Testing for epoch 26 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.0669
Epoch 27 of 60

Testing for epoch 27 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.0880

Testing for epoch 27 index 2:
16/16 [==============================] - 0s 800us/step - loss: 2.0889

Testing for epoch 27 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.1112

Testing for epoch 27 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.0641

Testing for epoch 27 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.0520
Epoch 28 of 60

Testing for epoch 28 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.0533

Testing for epoch 28 index 2:
16/16 [==============================] - 0s 601us/step - loss: 2.1067

Testing for epoch 28 index 3:
16/16 [==============================] - 0s 645us/step - loss: 2.1065

Testing for epoch 28 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.0956

Testing for epoch 28 index 5:
16/16 [==============================] - 0s 634us/step - loss: 2.0811
Epoch 29 of 60

Testing for epoch 29 index 1:
16/16 [==============================] - 0s 633us/step - loss: 2.0727

Testing for epoch 29 index 2:
16/16 [==============================] - 0s 687us/step - loss: 2.1834

Testing for epoch 29 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.0984

Testing for epoch 29 index 4:
16/16 [==============================] - 0s 599us/step - loss: 2.1578

Testing for epoch 29 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.1489
Epoch 30 of 60

Testing for epoch 30 index 1:
16/16 [==============================] - 0s 671us/step - loss: 2.1636

Testing for epoch 30 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.1516

Testing for epoch 30 index 3:
16/16 [==============================] - 0s 636us/step - loss: 2.1534

Testing for epoch 30 index 4:
16/16 [==============================] - 0s 776us/step - loss: 2.1465

Testing for epoch 30 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.1006
Epoch 31 of 60

Testing for epoch 31 index 1:
16/16 [==============================] - 0s 768us/step - loss: 2.1580

Testing for epoch 31 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.1679

Testing for epoch 31 index 3:
16/16 [==============================] - 0s 932us/step - loss: 2.1854

Testing for epoch 31 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.1869

Testing for epoch 31 index 5:
16/16 [==============================] - 0s 600us/step - loss: 2.1570
Epoch 32 of 60

Testing for epoch 32 index 1:
16/16 [==============================] - 0s 701us/step - loss: 2.2004

Testing for epoch 32 index 2:
16/16 [==============================] - 0s 664us/step - loss: 2.2094

Testing for epoch 32 index 3:
16/16 [==============================] - 0s 665us/step - loss: 2.2316

Testing for epoch 32 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.1808

Testing for epoch 32 index 5:
16/16 [==============================] - 0s 606us/step - loss: 2.2633
Epoch 33 of 60

Testing for epoch 33 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.2481

Testing for epoch 33 index 2:
16/16 [==============================] - 0s 629us/step - loss: 2.2154

Testing for epoch 33 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.2065

Testing for epoch 33 index 4:
16/16 [==============================] - 0s 632us/step - loss: 2.2313

Testing for epoch 33 index 5:
16/16 [==============================] - 0s 728us/step - loss: 2.2298
Epoch 34 of 60

Testing for epoch 34 index 1:
16/16 [==============================] - 0s 651us/step - loss: 2.2541

Testing for epoch 34 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.2413

Testing for epoch 34 index 3:
16/16 [==============================] - 0s 665us/step - loss: 2.1930

Testing for epoch 34 index 4:
16/16 [==============================] - 0s 607us/step - loss: 2.2856

Testing for epoch 34 index 5:
16/16 [==============================] - 0s 650us/step - loss: 2.2537
Epoch 35 of 60

Testing for epoch 35 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.2461

Testing for epoch 35 index 2:
16/16 [==============================] - 0s 654us/step - loss: 2.3097

Testing for epoch 35 index 3:
16/16 [==============================] - 0s 831us/step - loss: 2.3159

Testing for epoch 35 index 4:
16/16 [==============================] - 0s 934us/step - loss: 2.2306

Testing for epoch 35 index 5:
16/16 [==============================] - 0s 654us/step - loss: 2.2956
Epoch 36 of 60

Testing for epoch 36 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.2296

Testing for epoch 36 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.2378

Testing for epoch 36 index 3:
16/16 [==============================] - 0s 926us/step - loss: 2.2114

Testing for epoch 36 index 4:
16/16 [==============================] - 0s 716us/step - loss: 2.2166

Testing for epoch 36 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.2483
Epoch 37 of 60

Testing for epoch 37 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.2669

Testing for epoch 37 index 2:
16/16 [==============================] - 0s 718us/step - loss: 2.2966

Testing for epoch 37 index 3:
16/16 [==============================] - 0s 776us/step - loss: 2.2346

Testing for epoch 37 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.3040

Testing for epoch 37 index 5:
16/16 [==============================] - 0s 780us/step - loss: 2.3003
Epoch 38 of 60

Testing for epoch 38 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.2809

Testing for epoch 38 index 2:
16/16 [==============================] - 0s 789us/step - loss: 2.2804

Testing for epoch 38 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.2915

Testing for epoch 38 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.2829

Testing for epoch 38 index 5:
16/16 [==============================] - 0s 923us/step - loss: 2.3199
Epoch 39 of 60

Testing for epoch 39 index 1:
16/16 [==============================] - 0s 980us/step - loss: 2.2642

Testing for epoch 39 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.3208

Testing for epoch 39 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.3127

Testing for epoch 39 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.3514

Testing for epoch 39 index 5:
16/16 [==============================] - 0s 829us/step - loss: 2.3363
Epoch 40 of 60

Testing for epoch 40 index 1:
16/16 [==============================] - 0s 629us/step - loss: 2.3203

Testing for epoch 40 index 2:
16/16 [==============================] - 0s 658us/step - loss: 2.3100

Testing for epoch 40 index 3:
16/16 [==============================] - 0s 625us/step - loss: 2.2837

Testing for epoch 40 index 4:
16/16 [==============================] - 0s 640us/step - loss: 2.2877

Testing for epoch 40 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.3374
Epoch 41 of 60

Testing for epoch 41 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.3149

Testing for epoch 41 index 2:
16/16 [==============================] - 0s 658us/step - loss: 2.3535

Testing for epoch 41 index 3:
16/16 [==============================] - 0s 652us/step - loss: 2.3861

Testing for epoch 41 index 4:
16/16 [==============================] - 0s 723us/step - loss: 2.3328

Testing for epoch 41 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.3450
Epoch 42 of 60

Testing for epoch 42 index 1:
16/16 [==============================] - 0s 641us/step - loss: 2.3578

Testing for epoch 42 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.3235

Testing for epoch 42 index 3:
16/16 [==============================] - 0s 958us/step - loss: 2.3421

Testing for epoch 42 index 4:
16/16 [==============================] - 0s 593us/step - loss: 2.3656

Testing for epoch 42 index 5:
16/16 [==============================] - 0s 623us/step - loss: 2.3044
Epoch 43 of 60

Testing for epoch 43 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.3273

Testing for epoch 43 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.3797

Testing for epoch 43 index 3:
16/16 [==============================] - 0s 654us/step - loss: 2.3372

Testing for epoch 43 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.3387

Testing for epoch 43 index 5:
16/16 [==============================] - 0s 608us/step - loss: 2.4377
Epoch 44 of 60

Testing for epoch 44 index 1:
16/16 [==============================] - 0s 965us/step - loss: 2.4568

Testing for epoch 44 index 2:
16/16 [==============================] - 0s 640us/step - loss: 2.4050

Testing for epoch 44 index 3:
16/16 [==============================] - 0s 943us/step - loss: 2.3936

Testing for epoch 44 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.3910

Testing for epoch 44 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.4026
Epoch 45 of 60

Testing for epoch 45 index 1:
16/16 [==============================] - 0s 647us/step - loss: 2.4177

Testing for epoch 45 index 2:
16/16 [==============================] - 0s 941us/step - loss: 2.4015

Testing for epoch 45 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.3971

Testing for epoch 45 index 4:
16/16 [==============================] - 0s 678us/step - loss: 2.3933

Testing for epoch 45 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.4488
Epoch 46 of 60

Testing for epoch 46 index 1:
16/16 [==============================] - 0s 594us/step - loss: 2.3598

Testing for epoch 46 index 2:
16/16 [==============================] - 0s 655us/step - loss: 2.4883

Testing for epoch 46 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.4234

Testing for epoch 46 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.3641

Testing for epoch 46 index 5:
16/16 [==============================] - 0s 649us/step - loss: 2.4212
Epoch 47 of 60

Testing for epoch 47 index 1:
16/16 [==============================] - 0s 828us/step - loss: 2.5119

Testing for epoch 47 index 2:
16/16 [==============================] - 0s 625us/step - loss: 2.4255

Testing for epoch 47 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.4828

Testing for epoch 47 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.4336

Testing for epoch 47 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.3916
Epoch 48 of 60

Testing for epoch 48 index 1:
16/16 [==============================] - 0s 630us/step - loss: 2.4157

Testing for epoch 48 index 2:
16/16 [==============================] - 0s 621us/step - loss: 2.4543

Testing for epoch 48 index 3:
16/16 [==============================] - 0s 672us/step - loss: 2.3956

Testing for epoch 48 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.4783

Testing for epoch 48 index 5:
16/16 [==============================] - 0s 630us/step - loss: 2.4045
Epoch 49 of 60

Testing for epoch 49 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.4787

Testing for epoch 49 index 2:
16/16 [==============================] - 0s 880us/step - loss: 2.4557

Testing for epoch 49 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.4497

Testing for epoch 49 index 4:
16/16 [==============================] - 0s 635us/step - loss: 2.4115

Testing for epoch 49 index 5:
16/16 [==============================] - 0s 613us/step - loss: 2.4469
Epoch 50 of 60

Testing for epoch 50 index 1:
16/16 [==============================] - 0s 764us/step - loss: 2.4250

Testing for epoch 50 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.4706

Testing for epoch 50 index 3:
16/16 [==============================] - 0s 620us/step - loss: 2.3919

Testing for epoch 50 index 4:
16/16 [==============================] - 0s 698us/step - loss: 2.4463

Testing for epoch 50 index 5:
16/16 [==============================] - 0s 958us/step - loss: 2.4810
Epoch 51 of 60

Testing for epoch 51 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.4359

Testing for epoch 51 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.4080

Testing for epoch 51 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.4634

Testing for epoch 51 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.5226

Testing for epoch 51 index 5:
16/16 [==============================] - 0s 894us/step - loss: 2.4385
Epoch 52 of 60

Testing for epoch 52 index 1:
16/16 [==============================] - 0s 856us/step - loss: 2.5063

Testing for epoch 52 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.4672

Testing for epoch 52 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.5011

Testing for epoch 52 index 4:
16/16 [==============================] - 0s 618us/step - loss: 2.5610

Testing for epoch 52 index 5:
16/16 [==============================] - 0s 679us/step - loss: 2.5239
Epoch 53 of 60

Testing for epoch 53 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.5248

Testing for epoch 53 index 2:
16/16 [==============================] - 0s 990us/step - loss: 2.5142

Testing for epoch 53 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.5164

Testing for epoch 53 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.3996

Testing for epoch 53 index 5:
16/16 [==============================] - 0s 894us/step - loss: 2.4939
Epoch 54 of 60

Testing for epoch 54 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.4897

Testing for epoch 54 index 2:
16/16 [==============================] - 0s 617us/step - loss: 2.5320

Testing for epoch 54 index 3:
16/16 [==============================] - 0s 619us/step - loss: 2.5544

Testing for epoch 54 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.4986

Testing for epoch 54 index 5:
16/16 [==============================] - 0s 648us/step - loss: 2.5618
Epoch 55 of 60

Testing for epoch 55 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.5605

Testing for epoch 55 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.4780

Testing for epoch 55 index 3:
16/16 [==============================] - 0s 665us/step - loss: 2.4659

Testing for epoch 55 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 2.4696

Testing for epoch 55 index 5:
16/16 [==============================] - 0s 643us/step - loss: 2.5610
Epoch 56 of 60

Testing for epoch 56 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.4586

Testing for epoch 56 index 2:
16/16 [==============================] - 0s 665us/step - loss: 2.4735

Testing for epoch 56 index 3:
16/16 [==============================] - 0s 964us/step - loss: 2.5013

Testing for epoch 56 index 4:
16/16 [==============================] - 0s 840us/step - loss: 2.4765

Testing for epoch 56 index 5:
16/16 [==============================] - 0s 908us/step - loss: 2.5925
Epoch 57 of 60

Testing for epoch 57 index 1:
16/16 [==============================] - 0s 644us/step - loss: 2.5213

Testing for epoch 57 index 2:
16/16 [==============================] - 0s 624us/step - loss: 2.5540

Testing for epoch 57 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.5273

Testing for epoch 57 index 4:
16/16 [==============================] - 0s 665us/step - loss: 2.5155

Testing for epoch 57 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.5001
Epoch 58 of 60

Testing for epoch 58 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.5154

Testing for epoch 58 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.5593

Testing for epoch 58 index 3:
16/16 [==============================] - 0s 653us/step - loss: 2.4897

Testing for epoch 58 index 4:
16/16 [==============================] - 0s 621us/step - loss: 2.5391

Testing for epoch 58 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.5966
Epoch 59 of 60

Testing for epoch 59 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 2.5325

Testing for epoch 59 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 2.5563

Testing for epoch 59 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 2.4993

Testing for epoch 59 index 4:
16/16 [==============================] - 0s 625us/step - loss: 2.5589

Testing for epoch 59 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 2.5403
Epoch 60 of 60

Testing for epoch 60 index 1:
16/16 [==============================] - 0s 833us/step - loss: 2.5143

Testing for epoch 60 index 2:
16/16 [==============================] - 0s 808us/step - loss: 2.5618

Testing for epoch 60 index 3:
16/16 [==============================] - 0s 796us/step - loss: 2.5960

Testing for epoch 60 index 4:
16/16 [==============================] - 0s 599us/step - loss: 2.5405

Testing for epoch 60 index 5:
16/16 [==============================] - 0s 650us/step - loss: 2.5440

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/keras/optimizer_v2/gradient_descent.py:102: UserWarning: The `lr` argument is deprecated, use `learning_rate` instead.
  super(SGD, self).__init__(name, **kwargs)

outlier_SO_GAAL_one = list(clf.labels_)

outlier_SO_GAAL_one = list(map(lambda x: 1 if x==0  else -1,outlier_SO_GAAL_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_SO_GAAL_one,tab_bunny)

_conf.conf("SO-GAAL (Liu et al., 2019)")

Accuracy: 0.952
Precision: 0.952
Recall: 1.000
F1 Score: 0.975

twelve = eleven.append(_conf.tab)

MO_GAAL

clf = MO_GAAL()
clf.fit(_df[['x', 'y','fnoise']])
_df['MO_GAAL_clf'] = clf.labels_

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/keras/optimizer_v2/gradient_descent.py:102: UserWarning: The `lr` argument is deprecated, use `learning_rate` instead.
  super(SGD, self).__init__(name, **kwargs)

Epoch 1 of 60

Testing for epoch 1 index 1:

Testing for epoch 1 index 2:

Testing for epoch 1 index 3:

Testing for epoch 1 index 4:

Testing for epoch 1 index 5:
Epoch 2 of 60

Testing for epoch 2 index 1:

Testing for epoch 2 index 2:

Testing for epoch 2 index 3:

Testing for epoch 2 index 4:

Testing for epoch 2 index 5:
Epoch 3 of 60

Testing for epoch 3 index 1:

Testing for epoch 3 index 2:

Testing for epoch 3 index 3:

Testing for epoch 3 index 4:

Testing for epoch 3 index 5:
Epoch 4 of 60

Testing for epoch 4 index 1:

Testing for epoch 4 index 2:

Testing for epoch 4 index 3:

Testing for epoch 4 index 4:

Testing for epoch 4 index 5:
Epoch 5 of 60

Testing for epoch 5 index 1:

Testing for epoch 5 index 2:

Testing for epoch 5 index 3:

Testing for epoch 5 index 4:

Testing for epoch 5 index 5:
Epoch 6 of 60

Testing for epoch 6 index 1:

Testing for epoch 6 index 2:

Testing for epoch 6 index 3:

Testing for epoch 6 index 4:

Testing for epoch 6 index 5:
Epoch 7 of 60

Testing for epoch 7 index 1:

Testing for epoch 7 index 2:

Testing for epoch 7 index 3:

Testing for epoch 7 index 4:

Testing for epoch 7 index 5:
Epoch 8 of 60

Testing for epoch 8 index 1:

Testing for epoch 8 index 2:

Testing for epoch 8 index 3:

Testing for epoch 8 index 4:

Testing for epoch 8 index 5:
Epoch 9 of 60

Testing for epoch 9 index 1:

Testing for epoch 9 index 2:

Testing for epoch 9 index 3:

Testing for epoch 9 index 4:

Testing for epoch 9 index 5:
Epoch 10 of 60

Testing for epoch 10 index 1:

Testing for epoch 10 index 2:

Testing for epoch 10 index 3:

Testing for epoch 10 index 4:

Testing for epoch 10 index 5:
Epoch 11 of 60

Testing for epoch 11 index 1:

Testing for epoch 11 index 2:

Testing for epoch 11 index 3:

Testing for epoch 11 index 4:

Testing for epoch 11 index 5:
Epoch 12 of 60

Testing for epoch 12 index 1:

Testing for epoch 12 index 2:

Testing for epoch 12 index 3:

Testing for epoch 12 index 4:

Testing for epoch 12 index 5:
Epoch 13 of 60

Testing for epoch 13 index 1:

Testing for epoch 13 index 2:

Testing for epoch 13 index 3:

Testing for epoch 13 index 4:

Testing for epoch 13 index 5:
Epoch 14 of 60

Testing for epoch 14 index 1:

Testing for epoch 14 index 2:

Testing for epoch 14 index 3:

Testing for epoch 14 index 4:

Testing for epoch 14 index 5:
Epoch 15 of 60

Testing for epoch 15 index 1:

Testing for epoch 15 index 2:

Testing for epoch 15 index 3:

Testing for epoch 15 index 4:

Testing for epoch 15 index 5:
Epoch 16 of 60

Testing for epoch 16 index 1:

Testing for epoch 16 index 2:

Testing for epoch 16 index 3:

Testing for epoch 16 index 4:

Testing for epoch 16 index 5:
Epoch 17 of 60

Testing for epoch 17 index 1:

Testing for epoch 17 index 2:

Testing for epoch 17 index 3:

Testing for epoch 17 index 4:

Testing for epoch 17 index 5:
Epoch 18 of 60

Testing for epoch 18 index 1:

Testing for epoch 18 index 2:

Testing for epoch 18 index 3:

Testing for epoch 18 index 4:

Testing for epoch 18 index 5:
Epoch 19 of 60

Testing for epoch 19 index 1:

Testing for epoch 19 index 2:

Testing for epoch 19 index 3:

Testing for epoch 19 index 4:

Testing for epoch 19 index 5:
Epoch 20 of 60

Testing for epoch 20 index 1:

Testing for epoch 20 index 2:

Testing for epoch 20 index 3:

Testing for epoch 20 index 4:

Testing for epoch 20 index 5:
Epoch 21 of 60

Testing for epoch 21 index 1:

Testing for epoch 21 index 2:
16/16 [==============================] - 0s 839us/step - loss: 0.2862
16/16 [==============================] - 0s 1ms/step - loss: 1.3562
16/16 [==============================] - 0s 879us/step - loss: 1.6391
16/16 [==============================] - 0s 676us/step - loss: 1.7457
16/16 [==============================] - 0s 668us/step - loss: 1.7800
16/16 [==============================] - 0s 797us/step - loss: 1.7893
16/16 [==============================] - 0s 1ms/step - loss: 1.7882
16/16 [==============================] - 0s 750us/step - loss: 1.7810
16/16 [==============================] - 0s 661us/step - loss: 1.7768
16/16 [==============================] - 0s 1ms/step - loss: 1.7746

Testing for epoch 21 index 3:
16/16 [==============================] - 0s 709us/step - loss: 0.2829
16/16 [==============================] - 0s 1ms/step - loss: 1.3627
16/16 [==============================] - 0s 1ms/step - loss: 1.6520
16/16 [==============================] - 0s 1ms/step - loss: 1.7617
16/16 [==============================] - 0s 648us/step - loss: 1.7969
16/16 [==============================] - 0s 655us/step - loss: 1.8064
16/16 [==============================] - 0s 1ms/step - loss: 1.8050
16/16 [==============================] - 0s 1ms/step - loss: 1.7975
16/16 [==============================] - 0s 1ms/step - loss: 1.7932
16/16 [==============================] - 0s 1ms/step - loss: 1.7909

Testing for epoch 21 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2819
16/16 [==============================] - 0s 662us/step - loss: 1.3750
16/16 [==============================] - 0s 649us/step - loss: 1.6692
16/16 [==============================] - 0s 664us/step - loss: 1.7821
16/16 [==============================] - 0s 644us/step - loss: 1.8194
16/16 [==============================] - 0s 671us/step - loss: 1.8316
16/16 [==============================] - 0s 651us/step - loss: 1.8318
16/16 [==============================] - 0s 661us/step - loss: 1.8249
16/16 [==============================] - 0s 990us/step - loss: 1.8208
16/16 [==============================] - 0s 1ms/step - loss: 1.8185

Testing for epoch 21 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.2784
16/16 [==============================] - 0s 1ms/step - loss: 1.3590
16/16 [==============================] - 0s 645us/step - loss: 1.6490
16/16 [==============================] - 0s 1ms/step - loss: 1.7586
16/16 [==============================] - 0s 655us/step - loss: 1.7914
16/16 [==============================] - 0s 1ms/step - loss: 1.7998
16/16 [==============================] - 0s 1ms/step - loss: 1.7975
16/16 [==============================] - 0s 653us/step - loss: 1.7896
16/16 [==============================] - 0s 675us/step - loss: 1.7852
16/16 [==============================] - 0s 1ms/step - loss: 1.7829
Epoch 22 of 60

Testing for epoch 22 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2787
16/16 [==============================] - 0s 1ms/step - loss: 1.3475
16/16 [==============================] - 0s 646us/step - loss: 1.6341
16/16 [==============================] - 0s 690us/step - loss: 1.7422
16/16 [==============================] - 0s 1ms/step - loss: 1.7757
16/16 [==============================] - 0s 1ms/step - loss: 1.7855
16/16 [==============================] - 0s 1ms/step - loss: 1.7843
16/16 [==============================] - 0s 1ms/step - loss: 1.7771
16/16 [==============================] - 0s 1ms/step - loss: 1.7729
16/16 [==============================] - 0s 1ms/step - loss: 1.7708

Testing for epoch 22 index 2:
16/16 [==============================] - 0s 680us/step - loss: 0.2756
16/16 [==============================] - 0s 1ms/step - loss: 1.3616
16/16 [==============================] - 0s 678us/step - loss: 1.6485
16/16 [==============================] - 0s 946us/step - loss: 1.7539
16/16 [==============================] - 0s 673us/step - loss: 1.7847
16/16 [==============================] - 0s 656us/step - loss: 1.7921
16/16 [==============================] - 0s 1ms/step - loss: 1.7895
16/16 [==============================] - 0s 660us/step - loss: 1.7812
16/16 [==============================] - 0s 1ms/step - loss: 1.7768
16/16 [==============================] - 0s 730us/step - loss: 1.7745

Testing for epoch 22 index 3:
16/16 [==============================] - 0s 660us/step - loss: 0.2723
16/16 [==============================] - 0s 1ms/step - loss: 1.3959
16/16 [==============================] - 0s 642us/step - loss: 1.7002
16/16 [==============================] - 0s 874us/step - loss: 1.8105
16/16 [==============================] - 0s 1ms/step - loss: 1.8423
16/16 [==============================] - 0s 1ms/step - loss: 1.8494
16/16 [==============================] - 0s 657us/step - loss: 1.8460
16/16 [==============================] - 0s 940us/step - loss: 1.8371
16/16 [==============================] - 0s 634us/step - loss: 1.8324
16/16 [==============================] - 0s 905us/step - loss: 1.8299

Testing for epoch 22 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2702
16/16 [==============================] - 0s 649us/step - loss: 1.3792
16/16 [==============================] - 0s 867us/step - loss: 1.6818
16/16 [==============================] - 0s 619us/step - loss: 1.7923
16/16 [==============================] - 0s 859us/step - loss: 1.8248
16/16 [==============================] - 0s 609us/step - loss: 1.8327
16/16 [==============================] - 0s 1ms/step - loss: 1.8298
16/16 [==============================] - 0s 584us/step - loss: 1.8209
16/16 [==============================] - 0s 590us/step - loss: 1.8163
16/16 [==============================] - 0s 602us/step - loss: 1.8139

Testing for epoch 22 index 5:
16/16 [==============================] - 0s 683us/step - loss: 0.2694
16/16 [==============================] - 0s 794us/step - loss: 1.3853
16/16 [==============================] - 0s 1ms/step - loss: 1.6907
16/16 [==============================] - 0s 1ms/step - loss: 1.8014
16/16 [==============================] - 0s 634us/step - loss: 1.8329
16/16 [==============================] - 0s 1ms/step - loss: 1.8400
16/16 [==============================] - 0s 694us/step - loss: 1.8367
16/16 [==============================] - 0s 1ms/step - loss: 1.8275
16/16 [==============================] - 0s 589us/step - loss: 1.8228
16/16 [==============================] - 0s 1ms/step - loss: 1.8204
Epoch 23 of 60

Testing for epoch 23 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2679
16/16 [==============================] - 0s 1ms/step - loss: 1.4280
16/16 [==============================] - 0s 1ms/step - loss: 1.7530
16/16 [==============================] - 0s 1ms/step - loss: 1.8709
16/16 [==============================] - 0s 1ms/step - loss: 1.9036
16/16 [==============================] - 0s 643us/step - loss: 1.9107
16/16 [==============================] - 0s 1ms/step - loss: 1.9074
16/16 [==============================] - 0s 1ms/step - loss: 1.8981
16/16 [==============================] - 0s 1ms/step - loss: 1.8933
16/16 [==============================] - 0s 1ms/step - loss: 1.8908

Testing for epoch 23 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2673
16/16 [==============================] - 0s 974us/step - loss: 1.4127
16/16 [==============================] - 0s 820us/step - loss: 1.7343
16/16 [==============================] - 0s 630us/step - loss: 1.8524
16/16 [==============================] - 0s 606us/step - loss: 1.8844
16/16 [==============================] - 0s 719us/step - loss: 1.8917
16/16 [==============================] - 0s 1ms/step - loss: 1.8882
16/16 [==============================] - 0s 611us/step - loss: 1.8784
16/16 [==============================] - 0s 666us/step - loss: 1.8735
16/16 [==============================] - 0s 1ms/step - loss: 1.8709

Testing for epoch 23 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.2645
16/16 [==============================] - 0s 1ms/step - loss: 1.4021
16/16 [==============================] - 0s 594us/step - loss: 1.7169
16/16 [==============================] - 0s 587us/step - loss: 1.8300
16/16 [==============================] - 0s 613us/step - loss: 1.8582
16/16 [==============================] - 0s 1ms/step - loss: 1.8634
16/16 [==============================] - 0s 1ms/step - loss: 1.8590
16/16 [==============================] - 0s 644us/step - loss: 1.8494
16/16 [==============================] - 0s 622us/step - loss: 1.8445
16/16 [==============================] - 0s 617us/step - loss: 1.8420

Testing for epoch 23 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2641
16/16 [==============================] - 0s 1ms/step - loss: 1.4346
16/16 [==============================] - 0s 1ms/step - loss: 1.7641
16/16 [==============================] - 0s 860us/step - loss: 1.8848
16/16 [==============================] - 0s 1ms/step - loss: 1.9154
16/16 [==============================] - 0s 962us/step - loss: 1.9222
16/16 [==============================] - 0s 634us/step - loss: 1.9176
16/16 [==============================] - 0s 1ms/step - loss: 1.9075
16/16 [==============================] - 0s 640us/step - loss: 1.9024
16/16 [==============================] - 0s 1ms/step - loss: 1.8998

Testing for epoch 23 index 5:
16/16 [==============================] - 0s 935us/step - loss: 0.2571
16/16 [==============================] - 0s 600us/step - loss: 1.4423
16/16 [==============================] - 0s 1ms/step - loss: 1.7744
16/16 [==============================] - 0s 1ms/step - loss: 1.8942
16/16 [==============================] - 0s 1ms/step - loss: 1.9222
16/16 [==============================] - 0s 1ms/step - loss: 1.9268
16/16 [==============================] - 0s 702us/step - loss: 1.9205
16/16 [==============================] - 0s 637us/step - loss: 1.9092
16/16 [==============================] - 0s 1ms/step - loss: 1.9038
16/16 [==============================] - 0s 638us/step - loss: 1.9011
Epoch 24 of 60

Testing for epoch 24 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2576
16/16 [==============================] - 0s 1ms/step - loss: 1.4150
16/16 [==============================] - 0s 586us/step - loss: 1.7381
16/16 [==============================] - 0s 825us/step - loss: 1.8529
16/16 [==============================] - 0s 848us/step - loss: 1.8794
16/16 [==============================] - 0s 716us/step - loss: 1.8834
16/16 [==============================] - 0s 1ms/step - loss: 1.8775
16/16 [==============================] - 0s 598us/step - loss: 1.8670
16/16 [==============================] - 0s 614us/step - loss: 1.8618
16/16 [==============================] - 0s 1ms/step - loss: 1.8593

Testing for epoch 24 index 2:
16/16 [==============================] - 0s 604us/step - loss: 0.2602
16/16 [==============================] - 0s 1ms/step - loss: 1.4321
16/16 [==============================] - 0s 1ms/step - loss: 1.7581
16/16 [==============================] - 0s 1ms/step - loss: 1.8731
16/16 [==============================] - 0s 636us/step - loss: 1.8998
16/16 [==============================] - 0s 1ms/step - loss: 1.9035
16/16 [==============================] - 0s 607us/step - loss: 1.8975
16/16 [==============================] - 0s 1ms/step - loss: 1.8867
16/16 [==============================] - 0s 646us/step - loss: 1.8815
16/16 [==============================] - 0s 1ms/step - loss: 1.8790

Testing for epoch 24 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.2559
16/16 [==============================] - 0s 1ms/step - loss: 1.4384
16/16 [==============================] - 0s 610us/step - loss: 1.7673
16/16 [==============================] - 0s 1ms/step - loss: 1.8808
16/16 [==============================] - 0s 663us/step - loss: 1.9062
16/16 [==============================] - 0s 844us/step - loss: 1.9082
16/16 [==============================] - 0s 780us/step - loss: 1.9007
16/16 [==============================] - 0s 602us/step - loss: 1.8887
16/16 [==============================] - 0s 735us/step - loss: 1.8831
16/16 [==============================] - 0s 1ms/step - loss: 1.8805

Testing for epoch 24 index 4:
16/16 [==============================] - 0s 828us/step - loss: 0.2595
16/16 [==============================] - 0s 1ms/step - loss: 1.4660
16/16 [==============================] - 0s 1ms/step - loss: 1.8046
16/16 [==============================] - 0s 1ms/step - loss: 1.9238
16/16 [==============================] - 0s 613us/step - loss: 1.9510
16/16 [==============================] - 0s 613us/step - loss: 1.9550
16/16 [==============================] - 0s 607us/step - loss: 1.9486
16/16 [==============================] - 0s 600us/step - loss: 1.9375
16/16 [==============================] - 0s 1ms/step - loss: 1.9321
16/16 [==============================] - 0s 1ms/step - loss: 1.9295

Testing for epoch 24 index 5:
16/16 [==============================] - 0s 602us/step - loss: 0.2490
16/16 [==============================] - 0s 783us/step - loss: 1.4405
16/16 [==============================] - 0s 962us/step - loss: 1.7687
16/16 [==============================] - 0s 1ms/step - loss: 1.8795
16/16 [==============================] - 0s 1ms/step - loss: 1.9005
16/16 [==============================] - 0s 1ms/step - loss: 1.8995
16/16 [==============================] - 0s 1ms/step - loss: 1.8901
16/16 [==============================] - 0s 1ms/step - loss: 1.8774
16/16 [==============================] - 0s 1ms/step - loss: 1.8717
16/16 [==============================] - 0s 1ms/step - loss: 1.8690
Epoch 25 of 60

Testing for epoch 25 index 1:
16/16 [==============================] - 0s 951us/step - loss: 0.2496
16/16 [==============================] - 0s 610us/step - loss: 1.4539
16/16 [==============================] - 0s 1ms/step - loss: 1.7891
16/16 [==============================] - 0s 1ms/step - loss: 1.9046
16/16 [==============================] - 0s 628us/step - loss: 1.9285
16/16 [==============================] - 0s 645us/step - loss: 1.9295
16/16 [==============================] - 0s 1ms/step - loss: 1.9219
16/16 [==============================] - 0s 602us/step - loss: 1.9101
16/16 [==============================] - 0s 1ms/step - loss: 1.9046
16/16 [==============================] - 0s 888us/step - loss: 1.9020

Testing for epoch 25 index 2:
16/16 [==============================] - 0s 647us/step - loss: 0.2496
16/16 [==============================] - 0s 600us/step - loss: 1.4771
16/16 [==============================] - 0s 677us/step - loss: 1.8228
16/16 [==============================] - 0s 1ms/step - loss: 1.9419
16/16 [==============================] - 0s 663us/step - loss: 1.9656
16/16 [==============================] - 0s 1ms/step - loss: 1.9663
16/16 [==============================] - 0s 1ms/step - loss: 1.9579
16/16 [==============================] - 0s 629us/step - loss: 1.9450
16/16 [==============================] - 0s 638us/step - loss: 1.9393
16/16 [==============================] - 0s 1ms/step - loss: 1.9365

Testing for epoch 25 index 3:
16/16 [==============================] - 0s 652us/step - loss: 0.2531
16/16 [==============================] - 0s 591us/step - loss: 1.4810
16/16 [==============================] - 0s 613us/step - loss: 1.8268
16/16 [==============================] - 0s 1ms/step - loss: 1.9468
16/16 [==============================] - 0s 992us/step - loss: 1.9711
16/16 [==============================] - 0s 1ms/step - loss: 1.9715
16/16 [==============================] - 0s 595us/step - loss: 1.9633
16/16 [==============================] - 0s 1ms/step - loss: 1.9507
16/16 [==============================] - 0s 638us/step - loss: 1.9451
16/16 [==============================] - 0s 1ms/step - loss: 1.9424

Testing for epoch 25 index 4:
16/16 [==============================] - 0s 642us/step - loss: 0.2477
16/16 [==============================] - 0s 608us/step - loss: 1.4965
16/16 [==============================] - 0s 1ms/step - loss: 1.8427
16/16 [==============================] - 0s 1ms/step - loss: 1.9619
16/16 [==============================] - 0s 707us/step - loss: 1.9847
16/16 [==============================] - 0s 1ms/step - loss: 1.9844
16/16 [==============================] - 0s 1ms/step - loss: 1.9761
16/16 [==============================] - 0s 627us/step - loss: 1.9633
16/16 [==============================] - 0s 604us/step - loss: 1.9575
16/16 [==============================] - 0s 1ms/step - loss: 1.9548

Testing for epoch 25 index 5:
16/16 [==============================] - 0s 666us/step - loss: 0.2442
16/16 [==============================] - 0s 1ms/step - loss: 1.5123
16/16 [==============================] - 0s 663us/step - loss: 1.8671
16/16 [==============================] - 0s 868us/step - loss: 1.9886
16/16 [==============================] - 0s 1ms/step - loss: 2.0106
16/16 [==============================] - 0s 1ms/step - loss: 2.0090
16/16 [==============================] - 0s 1ms/step - loss: 1.9998
16/16 [==============================] - 0s 1ms/step - loss: 1.9861
16/16 [==============================] - 0s 1ms/step - loss: 1.9801
16/16 [==============================] - 0s 897us/step - loss: 1.9772
Epoch 26 of 60

Testing for epoch 26 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2455
16/16 [==============================] - 0s 641us/step - loss: 1.4842
16/16 [==============================] - 0s 1ms/step - loss: 1.8252
16/16 [==============================] - 0s 604us/step - loss: 1.9429
16/16 [==============================] - 0s 853us/step - loss: 1.9640
16/16 [==============================] - 0s 1ms/step - loss: 1.9625
16/16 [==============================] - 0s 616us/step - loss: 1.9538
16/16 [==============================] - 0s 861us/step - loss: 1.9412
16/16 [==============================] - 0s 1ms/step - loss: 1.9356
16/16 [==============================] - 0s 1ms/step - loss: 1.9330

Testing for epoch 26 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2433
16/16 [==============================] - 0s 1ms/step - loss: 1.4858
16/16 [==============================] - 0s 837us/step - loss: 1.8253
16/16 [==============================] - 0s 1ms/step - loss: 1.9440
16/16 [==============================] - 0s 1ms/step - loss: 1.9633
16/16 [==============================] - 0s 1ms/step - loss: 1.9608
16/16 [==============================] - 0s 1ms/step - loss: 1.9512
16/16 [==============================] - 0s 595us/step - loss: 1.9375
16/16 [==============================] - 0s 623us/step - loss: 1.9316
16/16 [==============================] - 0s 632us/step - loss: 1.9289

Testing for epoch 26 index 3:
16/16 [==============================] - 0s 947us/step - loss: 0.2431
16/16 [==============================] - 0s 727us/step - loss: 1.5060
16/16 [==============================] - 0s 614us/step - loss: 1.8472
16/16 [==============================] - 0s 619us/step - loss: 1.9665
16/16 [==============================] - 0s 1ms/step - loss: 1.9845
16/16 [==============================] - 0s 1ms/step - loss: 1.9803
16/16 [==============================] - 0s 1ms/step - loss: 1.9697
16/16 [==============================] - 0s 640us/step - loss: 1.9554
16/16 [==============================] - 0s 1ms/step - loss: 1.9494
16/16 [==============================] - 0s 1ms/step - loss: 1.9467

Testing for epoch 26 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2399
16/16 [==============================] - 0s 1ms/step - loss: 1.4785
16/16 [==============================] - 0s 1ms/step - loss: 1.8107
16/16 [==============================] - 0s 571us/step - loss: 1.9298
16/16 [==============================] - 0s 1ms/step - loss: 1.9481
16/16 [==============================] - 0s 1ms/step - loss: 1.9445
16/16 [==============================] - 0s 625us/step - loss: 1.9342
16/16 [==============================] - 0s 631us/step - loss: 1.9201
16/16 [==============================] - 0s 646us/step - loss: 1.9141
16/16 [==============================] - 0s 626us/step - loss: 1.9114

Testing for epoch 26 index 5:
16/16 [==============================] - 0s 880us/step - loss: 0.2394
16/16 [==============================] - 0s 1ms/step - loss: 1.5075
16/16 [==============================] - 0s 632us/step - loss: 1.8517
16/16 [==============================] - 0s 687us/step - loss: 1.9741
16/16 [==============================] - 0s 644us/step - loss: 1.9911
16/16 [==============================] - 0s 671us/step - loss: 1.9874
16/16 [==============================] - 0s 621us/step - loss: 1.9765
16/16 [==============================] - 0s 604us/step - loss: 1.9621
16/16 [==============================] - 0s 610us/step - loss: 1.9561
16/16 [==============================] - 0s 1ms/step - loss: 1.9533
Epoch 27 of 60

Testing for epoch 27 index 1:
16/16 [==============================] - 0s 626us/step - loss: 0.2399
16/16 [==============================] - 0s 1ms/step - loss: 1.5196
16/16 [==============================] - 0s 1ms/step - loss: 1.8658
16/16 [==============================] - 0s 1ms/step - loss: 1.9878
16/16 [==============================] - 0s 937us/step - loss: 2.0043
16/16 [==============================] - 0s 1ms/step - loss: 2.0001
16/16 [==============================] - 0s 755us/step - loss: 1.9881
16/16 [==============================] - 0s 607us/step - loss: 1.9734
16/16 [==============================] - 0s 1ms/step - loss: 1.9673
16/16 [==============================] - 0s 675us/step - loss: 1.9644

Testing for epoch 27 index 2:
16/16 [==============================] - 0s 584us/step - loss: 0.2383
16/16 [==============================] - 0s 1ms/step - loss: 1.5491
16/16 [==============================] - 0s 1ms/step - loss: 1.9024
16/16 [==============================] - 0s 587us/step - loss: 2.0252
16/16 [==============================] - 0s 793us/step - loss: 2.0399
16/16 [==============================] - 0s 1ms/step - loss: 2.0364
16/16 [==============================] - 0s 589us/step - loss: 2.0246
16/16 [==============================] - 0s 625us/step - loss: 2.0102
16/16 [==============================] - 0s 604us/step - loss: 2.0042
16/16 [==============================] - 0s 600us/step - loss: 2.0014

Testing for epoch 27 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.2373
16/16 [==============================] - 0s 1ms/step - loss: 1.5548
16/16 [==============================] - 0s 1ms/step - loss: 1.9083
16/16 [==============================] - 0s 1ms/step - loss: 2.0331
16/16 [==============================] - 0s 594us/step - loss: 2.0485
16/16 [==============================] - 0s 609us/step - loss: 2.0460
16/16 [==============================] - 0s 917us/step - loss: 2.0331
16/16 [==============================] - 0s 1ms/step - loss: 2.0181
16/16 [==============================] - 0s 1ms/step - loss: 2.0119
16/16 [==============================] - 0s 1ms/step - loss: 2.0090

Testing for epoch 27 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2391
16/16 [==============================] - 0s 713us/step - loss: 1.5529
16/16 [==============================] - 0s 1ms/step - loss: 1.9056
16/16 [==============================] - 0s 666us/step - loss: 2.0294
16/16 [==============================] - 0s 1ms/step - loss: 2.0429
16/16 [==============================] - 0s 1ms/step - loss: 2.0388
16/16 [==============================] - 0s 1ms/step - loss: 2.0248
16/16 [==============================] - 0s 1ms/step - loss: 2.0092
16/16 [==============================] - 0s 1ms/step - loss: 2.0028
16/16 [==============================] - 0s 1ms/step - loss: 1.9998

Testing for epoch 27 index 5:
16/16 [==============================] - 0s 643us/step - loss: 0.2391
16/16 [==============================] - 0s 1ms/step - loss: 1.5363
16/16 [==============================] - 0s 896us/step - loss: 1.8850
16/16 [==============================] - 0s 1ms/step - loss: 2.0052
16/16 [==============================] - 0s 610us/step - loss: 2.0195
16/16 [==============================] - 0s 1ms/step - loss: 2.0152
16/16 [==============================] - 0s 1ms/step - loss: 2.0012
16/16 [==============================] - 0s 1ms/step - loss: 1.9857
16/16 [==============================] - 0s 619us/step - loss: 1.9794
16/16 [==============================] - 0s 1ms/step - loss: 1.9765
Epoch 28 of 60

Testing for epoch 28 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2338
16/16 [==============================] - 0s 1ms/step - loss: 1.5579
16/16 [==============================] - 0s 624us/step - loss: 1.9117
16/16 [==============================] - 0s 1ms/step - loss: 2.0320
16/16 [==============================] - 0s 612us/step - loss: 2.0450
16/16 [==============================] - 0s 645us/step - loss: 2.0389
16/16 [==============================] - 0s 721us/step - loss: 2.0244
16/16 [==============================] - 0s 696us/step - loss: 2.0088
16/16 [==============================] - 0s 608us/step - loss: 2.0024
16/16 [==============================] - 0s 826us/step - loss: 1.9995

Testing for epoch 28 index 2:
16/16 [==============================] - 0s 748us/step - loss: 0.2338
16/16 [==============================] - 0s 1ms/step - loss: 1.5385
16/16 [==============================] - 0s 1ms/step - loss: 1.8839
16/16 [==============================] - 0s 670us/step - loss: 2.0016
16/16 [==============================] - 0s 626us/step - loss: 2.0138
16/16 [==============================] - 0s 625us/step - loss: 2.0076
16/16 [==============================] - 0s 1ms/step - loss: 1.9939
16/16 [==============================] - 0s 579us/step - loss: 1.9788
16/16 [==============================] - 0s 898us/step - loss: 1.9727
16/16 [==============================] - 0s 1ms/step - loss: 1.9699

Testing for epoch 28 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.2316
16/16 [==============================] - 0s 590us/step - loss: 1.5536
16/16 [==============================] - 0s 627us/step - loss: 1.9020
16/16 [==============================] - 0s 1ms/step - loss: 2.0198
16/16 [==============================] - 0s 1ms/step - loss: 2.0311
16/16 [==============================] - 0s 1ms/step - loss: 2.0229
16/16 [==============================] - 0s 646us/step - loss: 2.0074
16/16 [==============================] - 0s 606us/step - loss: 1.9907
16/16 [==============================] - 0s 591us/step - loss: 1.9841
16/16 [==============================] - 0s 1ms/step - loss: 1.9812

Testing for epoch 28 index 4:
16/16 [==============================] - 0s 618us/step - loss: 0.2325
16/16 [==============================] - 0s 1ms/step - loss: 1.5661
16/16 [==============================] - 0s 654us/step - loss: 1.9179
16/16 [==============================] - 0s 1ms/step - loss: 2.0361
16/16 [==============================] - 0s 1ms/step - loss: 2.0486
16/16 [==============================] - 0s 589us/step - loss: 2.0418
16/16 [==============================] - 0s 676us/step - loss: 2.0272
16/16 [==============================] - 0s 686us/step - loss: 2.0113
16/16 [==============================] - 0s 664us/step - loss: 2.0049
16/16 [==============================] - 0s 1ms/step - loss: 2.0020

Testing for epoch 28 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.2280
16/16 [==============================] - 0s 1ms/step - loss: 1.5553
16/16 [==============================] - 0s 646us/step - loss: 1.9013
16/16 [==============================] - 0s 1ms/step - loss: 2.0131
16/16 [==============================] - 0s 929us/step - loss: 2.0218
16/16 [==============================] - 0s 838us/step - loss: 2.0122
16/16 [==============================] - 0s 882us/step - loss: 1.9958
16/16 [==============================] - 0s 602us/step - loss: 1.9791
16/16 [==============================] - 0s 608us/step - loss: 1.9725
16/16 [==============================] - 0s 657us/step - loss: 1.9696
Epoch 29 of 60

Testing for epoch 29 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2275
16/16 [==============================] - 0s 767us/step - loss: 1.6042
16/16 [==============================] - 0s 629us/step - loss: 1.9618
16/16 [==============================] - 0s 1ms/step - loss: 2.0777
16/16 [==============================] - 0s 1ms/step - loss: 2.0859
16/16 [==============================] - 0s 645us/step - loss: 2.0750
16/16 [==============================] - 0s 646us/step - loss: 2.0571
16/16 [==============================] - 0s 900us/step - loss: 2.0390
16/16 [==============================] - 0s 1ms/step - loss: 2.0319
16/16 [==============================] - 0s 1ms/step - loss: 2.0288

Testing for epoch 29 index 2:
16/16 [==============================] - 0s 600us/step - loss: 0.2278
16/16 [==============================] - 0s 625us/step - loss: 1.6003
16/16 [==============================] - 0s 627us/step - loss: 1.9580
16/16 [==============================] - 0s 599us/step - loss: 2.0748
16/16 [==============================] - 0s 608us/step - loss: 2.0844
16/16 [==============================] - 0s 1ms/step - loss: 2.0744
16/16 [==============================] - 0s 911us/step - loss: 2.0568
16/16 [==============================] - 0s 1ms/step - loss: 2.0391
16/16 [==============================] - 0s 1ms/step - loss: 2.0323
16/16 [==============================] - 0s 632us/step - loss: 2.0293

Testing for epoch 29 index 3:
16/16 [==============================] - 0s 606us/step - loss: 0.2275
16/16 [==============================] - 0s 640us/step - loss: 1.5908
16/16 [==============================] - 0s 787us/step - loss: 1.9416
16/16 [==============================] - 0s 614us/step - loss: 2.0550
16/16 [==============================] - 0s 655us/step - loss: 2.0633
16/16 [==============================] - 0s 1ms/step - loss: 2.0544
16/16 [==============================] - 0s 624us/step - loss: 2.0373
16/16 [==============================] - 0s 590us/step - loss: 2.0202
16/16 [==============================] - 0s 665us/step - loss: 2.0135
16/16 [==============================] - 0s 1ms/step - loss: 2.0105

Testing for epoch 29 index 4:
16/16 [==============================] - 0s 637us/step - loss: 0.2262
16/16 [==============================] - 0s 1ms/step - loss: 1.6456
16/16 [==============================] - 0s 861us/step - loss: 2.0122
16/16 [==============================] - 0s 1ms/step - loss: 2.1306
16/16 [==============================] - 0s 1ms/step - loss: 2.1391
16/16 [==============================] - 0s 1ms/step - loss: 2.1297
16/16 [==============================] - 0s 621us/step - loss: 2.1118
16/16 [==============================] - 0s 608us/step - loss: 2.0941
16/16 [==============================] - 0s 1ms/step - loss: 2.0872
16/16 [==============================] - 0s 652us/step - loss: 2.0842

Testing for epoch 29 index 5:
16/16 [==============================] - 0s 876us/step - loss: 0.2207
16/16 [==============================] - 0s 656us/step - loss: 1.5952
16/16 [==============================] - 0s 647us/step - loss: 1.9409
16/16 [==============================] - 0s 611us/step - loss: 2.0496
16/16 [==============================] - 0s 616us/step - loss: 2.0545
16/16 [==============================] - 0s 1ms/step - loss: 2.0428
16/16 [==============================] - 0s 599us/step - loss: 2.0236
16/16 [==============================] - 0s 625us/step - loss: 2.0050
16/16 [==============================] - 0s 897us/step - loss: 1.9980
16/16 [==============================] - 0s 1ms/step - loss: 1.9949
Epoch 30 of 60

Testing for epoch 30 index 1:
16/16 [==============================] - 0s 595us/step - loss: 0.2217
16/16 [==============================] - 0s 1ms/step - loss: 1.6089
16/16 [==============================] - 0s 1ms/step - loss: 1.9546
16/16 [==============================] - 0s 1ms/step - loss: 2.0641
16/16 [==============================] - 0s 638us/step - loss: 2.0694
16/16 [==============================] - 0s 636us/step - loss: 2.0580
16/16 [==============================] - 0s 1ms/step - loss: 2.0394
16/16 [==============================] - 0s 1ms/step - loss: 2.0217
16/16 [==============================] - 0s 673us/step - loss: 2.0150
16/16 [==============================] - 0s 1ms/step - loss: 2.0120

Testing for epoch 30 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2210
16/16 [==============================] - 0s 828us/step - loss: 1.6202
16/16 [==============================] - 0s 1ms/step - loss: 1.9660
16/16 [==============================] - 0s 1ms/step - loss: 2.0750
16/16 [==============================] - 0s 1ms/step - loss: 2.0805
16/16 [==============================] - 0s 655us/step - loss: 2.0695
16/16 [==============================] - 0s 1ms/step - loss: 2.0510
16/16 [==============================] - 0s 1ms/step - loss: 2.0329
16/16 [==============================] - 0s 681us/step - loss: 2.0260
16/16 [==============================] - 0s 660us/step - loss: 2.0231

Testing for epoch 30 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.2210
16/16 [==============================] - 0s 1ms/step - loss: 1.6647
16/16 [==============================] - 0s 1ms/step - loss: 2.0279
16/16 [==============================] - 0s 1ms/step - loss: 2.1422
16/16 [==============================] - 0s 638us/step - loss: 2.1469
16/16 [==============================] - 0s 1ms/step - loss: 2.1338
16/16 [==============================] - 0s 787us/step - loss: 2.1132
16/16 [==============================] - 0s 1ms/step - loss: 2.0938
16/16 [==============================] - 0s 1ms/step - loss: 2.0865
16/16 [==============================] - 0s 1ms/step - loss: 2.0833

Testing for epoch 30 index 4:
16/16 [==============================] - 0s 636us/step - loss: 0.2203
16/16 [==============================] - 0s 640us/step - loss: 1.6660
16/16 [==============================] - 0s 629us/step - loss: 2.0216
16/16 [==============================] - 0s 1ms/step - loss: 2.1328
16/16 [==============================] - 0s 607us/step - loss: 2.1365
16/16 [==============================] - 0s 1ms/step - loss: 2.1239
16/16 [==============================] - 0s 1ms/step - loss: 2.1042
16/16 [==============================] - 0s 1ms/step - loss: 2.0851
16/16 [==============================] - 0s 637us/step - loss: 2.0778
16/16 [==============================] - 0s 1ms/step - loss: 2.0747

Testing for epoch 30 index 5:
16/16 [==============================] - 0s 975us/step - loss: 0.2161
16/16 [==============================] - 0s 1ms/step - loss: 1.6263
16/16 [==============================] - 0s 1ms/step - loss: 1.9708
16/16 [==============================] - 0s 601us/step - loss: 2.0786
16/16 [==============================] - 0s 806us/step - loss: 2.0799
16/16 [==============================] - 0s 787us/step - loss: 2.0658
16/16 [==============================] - 0s 870us/step - loss: 2.0449
16/16 [==============================] - 0s 1ms/step - loss: 2.0250
16/16 [==============================] - 0s 1ms/step - loss: 2.0177
16/16 [==============================] - 0s 826us/step - loss: 2.0146
Epoch 31 of 60

Testing for epoch 31 index 1:
16/16 [==============================] - 0s 611us/step - loss: 0.2170
16/16 [==============================] - 0s 1ms/step - loss: 1.6675
16/16 [==============================] - 0s 814us/step - loss: 2.0171
16/16 [==============================] - 0s 610us/step - loss: 2.1244
16/16 [==============================] - 0s 619us/step - loss: 2.1233
16/16 [==============================] - 0s 1ms/step - loss: 2.1079
16/16 [==============================] - 0s 856us/step - loss: 2.0871
16/16 [==============================] - 0s 1ms/step - loss: 2.0677
16/16 [==============================] - 0s 632us/step - loss: 2.0605
16/16 [==============================] - 0s 602us/step - loss: 2.0574

Testing for epoch 31 index 2:
16/16 [==============================] - 0s 636us/step - loss: 0.2144
16/16 [==============================] - 0s 709us/step - loss: 1.6430
16/16 [==============================] - 0s 667us/step - loss: 1.9817
16/16 [==============================] - 0s 682us/step - loss: 2.0881
16/16 [==============================] - 0s 1ms/step - loss: 2.0878
16/16 [==============================] - 0s 1ms/step - loss: 2.0724
16/16 [==============================] - 0s 629us/step - loss: 2.0513
16/16 [==============================] - 0s 1ms/step - loss: 2.0314
16/16 [==============================] - 0s 884us/step - loss: 2.0241
16/16 [==============================] - 0s 585us/step - loss: 2.0210

Testing for epoch 31 index 3:
16/16 [==============================] - 0s 726us/step - loss: 0.2157
16/16 [==============================] - 0s 1ms/step - loss: 1.6566
16/16 [==============================] - 0s 1ms/step - loss: 2.0048
16/16 [==============================] - 0s 708us/step - loss: 2.1166
16/16 [==============================] - 0s 1ms/step - loss: 2.1189
16/16 [==============================] - 0s 1ms/step - loss: 2.1054
16/16 [==============================] - 0s 684us/step - loss: 2.0858
16/16 [==============================] - 0s 922us/step - loss: 2.0670
16/16 [==============================] - 0s 1ms/step - loss: 2.0600
16/16 [==============================] - 0s 602us/step - loss: 2.0569

Testing for epoch 31 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2162
16/16 [==============================] - 0s 1ms/step - loss: 1.6785
16/16 [==============================] - 0s 1ms/step - loss: 2.0249
16/16 [==============================] - 0s 1ms/step - loss: 2.1348
16/16 [==============================] - 0s 630us/step - loss: 2.1339
16/16 [==============================] - 0s 1ms/step - loss: 2.1192
16/16 [==============================] - 0s 604us/step - loss: 2.0985
16/16 [==============================] - 0s 660us/step - loss: 2.0787
16/16 [==============================] - 0s 741us/step - loss: 2.0714
16/16 [==============================] - 0s 1ms/step - loss: 2.0683

Testing for epoch 31 index 5:
16/16 [==============================] - 0s 636us/step - loss: 0.2121
16/16 [==============================] - 0s 1ms/step - loss: 1.7297
16/16 [==============================] - 0s 1ms/step - loss: 2.0914
16/16 [==============================] - 0s 1ms/step - loss: 2.2077
16/16 [==============================] - 0s 615us/step - loss: 2.2066
16/16 [==============================] - 0s 615us/step - loss: 2.1895
16/16 [==============================] - 0s 1ms/step - loss: 2.1665
16/16 [==============================] - 0s 659us/step - loss: 2.1450
16/16 [==============================] - 0s 1ms/step - loss: 2.1372
16/16 [==============================] - 0s 911us/step - loss: 2.1339
Epoch 32 of 60

Testing for epoch 32 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2120
16/16 [==============================] - 0s 787us/step - loss: 1.7164
16/16 [==============================] - 0s 644us/step - loss: 2.0674
16/16 [==============================] - 0s 629us/step - loss: 2.1800
16/16 [==============================] - 0s 1ms/step - loss: 2.1770
16/16 [==============================] - 0s 652us/step - loss: 2.1600
16/16 [==============================] - 0s 620us/step - loss: 2.1373
16/16 [==============================] - 0s 784us/step - loss: 2.1164
16/16 [==============================] - 0s 644us/step - loss: 2.1088
16/16 [==============================] - 0s 606us/step - loss: 2.1055

Testing for epoch 32 index 2:
16/16 [==============================] - 0s 685us/step - loss: 0.2108
16/16 [==============================] - 0s 789us/step - loss: 1.7226
16/16 [==============================] - 0s 653us/step - loss: 2.0726
16/16 [==============================] - 0s 1ms/step - loss: 2.1850
16/16 [==============================] - 0s 737us/step - loss: 2.1834
16/16 [==============================] - 0s 659us/step - loss: 2.1657
16/16 [==============================] - 0s 633us/step - loss: 2.1428
16/16 [==============================] - 0s 851us/step - loss: 2.1217
16/16 [==============================] - 0s 636us/step - loss: 2.1141
16/16 [==============================] - 0s 599us/step - loss: 2.1108

Testing for epoch 32 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.2095
16/16 [==============================] - 0s 894us/step - loss: 1.7267
16/16 [==============================] - 0s 693us/step - loss: 2.0755
16/16 [==============================] - 0s 1ms/step - loss: 2.1840
16/16 [==============================] - 0s 1ms/step - loss: 2.1795
16/16 [==============================] - 0s 932us/step - loss: 2.1586
16/16 [==============================] - 0s 617us/step - loss: 2.1342
16/16 [==============================] - 0s 1ms/step - loss: 2.1125
16/16 [==============================] - 0s 672us/step - loss: 2.1046
16/16 [==============================] - 0s 1ms/step - loss: 2.1013

Testing for epoch 32 index 4:
16/16 [==============================] - 0s 629us/step - loss: 0.2097
16/16 [==============================] - 0s 656us/step - loss: 1.7201
16/16 [==============================] - 0s 725us/step - loss: 2.0713
16/16 [==============================] - 0s 610us/step - loss: 2.1837
16/16 [==============================] - 0s 857us/step - loss: 2.1826
16/16 [==============================] - 0s 1ms/step - loss: 2.1660
16/16 [==============================] - 0s 619us/step - loss: 2.1441
16/16 [==============================] - 0s 1ms/step - loss: 2.1235
16/16 [==============================] - 0s 759us/step - loss: 2.1159
16/16 [==============================] - 0s 1ms/step - loss: 2.1127

Testing for epoch 32 index 5:
16/16 [==============================] - 0s 617us/step - loss: 0.2078
16/16 [==============================] - 0s 1ms/step - loss: 1.7352
16/16 [==============================] - 0s 633us/step - loss: 2.0834
16/16 [==============================] - 0s 617us/step - loss: 2.1909
16/16 [==============================] - 0s 661us/step - loss: 2.1858
16/16 [==============================] - 0s 635us/step - loss: 2.1659
16/16 [==============================] - 0s 675us/step - loss: 2.1419
16/16 [==============================] - 0s 1ms/step - loss: 2.1201
16/16 [==============================] - 0s 638us/step - loss: 2.1122
16/16 [==============================] - 0s 924us/step - loss: 2.1089
Epoch 33 of 60

Testing for epoch 33 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.2075
16/16 [==============================] - 0s 1ms/step - loss: 1.7201
16/16 [==============================] - 0s 808us/step - loss: 2.0682
16/16 [==============================] - 0s 1ms/step - loss: 2.1789
16/16 [==============================] - 0s 1ms/step - loss: 2.1772
16/16 [==============================] - 0s 832us/step - loss: 2.1596
16/16 [==============================] - 0s 1ms/step - loss: 2.1366
16/16 [==============================] - 0s 631us/step - loss: 2.1155
16/16 [==============================] - 0s 1ms/step - loss: 2.1079
16/16 [==============================] - 0s 717us/step - loss: 2.1048

Testing for epoch 33 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.2033
16/16 [==============================] - 0s 880us/step - loss: 1.7117
16/16 [==============================] - 0s 689us/step - loss: 2.0529
16/16 [==============================] - 0s 646us/step - loss: 2.1588
16/16 [==============================] - 0s 629us/step - loss: 2.1535
16/16 [==============================] - 0s 977us/step - loss: 2.1332
16/16 [==============================] - 0s 564us/step - loss: 2.1092
16/16 [==============================] - 0s 647us/step - loss: 2.0876
16/16 [==============================] - 0s 1ms/step - loss: 2.0798
16/16 [==============================] - 0s 591us/step - loss: 2.0766

Testing for epoch 33 index 3:
16/16 [==============================] - 0s 990us/step - loss: 0.2022
16/16 [==============================] - 0s 1ms/step - loss: 1.7204
16/16 [==============================] - 0s 612us/step - loss: 2.0604
16/16 [==============================] - 0s 631us/step - loss: 2.1673
16/16 [==============================] - 0s 1ms/step - loss: 2.1620
16/16 [==============================] - 0s 629us/step - loss: 2.1416
16/16 [==============================] - 0s 929us/step - loss: 2.1173
16/16 [==============================] - 0s 1ms/step - loss: 2.0956
16/16 [==============================] - 0s 1ms/step - loss: 2.0879
16/16 [==============================] - 0s 617us/step - loss: 2.0846

Testing for epoch 33 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.2030
16/16 [==============================] - 0s 1ms/step - loss: 1.7209
16/16 [==============================] - 0s 605us/step - loss: 2.0625
16/16 [==============================] - 0s 1ms/step - loss: 2.1710
16/16 [==============================] - 0s 700us/step - loss: 2.1667
16/16 [==============================] - 0s 1ms/step - loss: 2.1474
16/16 [==============================] - 0s 902us/step - loss: 2.1242
16/16 [==============================] - 0s 667us/step - loss: 2.1033
16/16 [==============================] - 0s 1ms/step - loss: 2.0957
16/16 [==============================] - 0s 1ms/step - loss: 2.0925

Testing for epoch 33 index 5:
16/16 [==============================] - 0s 621us/step - loss: 0.2029
16/16 [==============================] - 0s 610us/step - loss: 1.7547
16/16 [==============================] - 0s 611us/step - loss: 2.1118
16/16 [==============================] - 0s 597us/step - loss: 2.2254
16/16 [==============================] - 0s 576us/step - loss: 2.2233
16/16 [==============================] - 0s 580us/step - loss: 2.2050
16/16 [==============================] - 0s 612us/step - loss: 2.1821
16/16 [==============================] - 0s 605us/step - loss: 2.1610
16/16 [==============================] - 0s 807us/step - loss: 2.1534
16/16 [==============================] - 0s 1ms/step - loss: 2.1502
Epoch 34 of 60

Testing for epoch 34 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1969
16/16 [==============================] - 0s 955us/step - loss: 1.7401
16/16 [==============================] - 0s 642us/step - loss: 2.0891
16/16 [==============================] - 0s 691us/step - loss: 2.1926
16/16 [==============================] - 0s 1ms/step - loss: 2.1827
16/16 [==============================] - 0s 706us/step - loss: 2.1592
16/16 [==============================] - 0s 1ms/step - loss: 2.1331
16/16 [==============================] - 0s 835us/step - loss: 2.1100
16/16 [==============================] - 0s 1ms/step - loss: 2.1018
16/16 [==============================] - 0s 1ms/step - loss: 2.0983

Testing for epoch 34 index 2:
16/16 [==============================] - 0s 659us/step - loss: 0.1983
16/16 [==============================] - 0s 664us/step - loss: 1.7511
16/16 [==============================] - 0s 1ms/step - loss: 2.1021
16/16 [==============================] - 0s 632us/step - loss: 2.2065
16/16 [==============================] - 0s 1ms/step - loss: 2.1983
16/16 [==============================] - 0s 1ms/step - loss: 2.1764
16/16 [==============================] - 0s 1ms/step - loss: 2.1510
16/16 [==============================] - 0s 639us/step - loss: 2.1285
16/16 [==============================] - 0s 641us/step - loss: 2.1205
16/16 [==============================] - 0s 1ms/step - loss: 2.1171

Testing for epoch 34 index 3:
16/16 [==============================] - 0s 774us/step - loss: 0.1992
16/16 [==============================] - 0s 643us/step - loss: 1.7271
16/16 [==============================] - 0s 1ms/step - loss: 2.0661
16/16 [==============================] - 0s 1ms/step - loss: 2.1656
16/16 [==============================] - 0s 1ms/step - loss: 2.1575
16/16 [==============================] - 0s 1ms/step - loss: 2.1343
16/16 [==============================] - 0s 620us/step - loss: 2.1083
16/16 [==============================] - 0s 675us/step - loss: 2.0856
16/16 [==============================] - 0s 1ms/step - loss: 2.0776
16/16 [==============================] - 0s 641us/step - loss: 2.0743

Testing for epoch 34 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1973
16/16 [==============================] - 0s 634us/step - loss: 1.7673
16/16 [==============================] - 0s 641us/step - loss: 2.1133
16/16 [==============================] - 0s 807us/step - loss: 2.2143
16/16 [==============================] - 0s 1ms/step - loss: 2.2060
16/16 [==============================] - 0s 680us/step - loss: 2.1823
16/16 [==============================] - 0s 915us/step - loss: 2.1568
16/16 [==============================] - 0s 1ms/step - loss: 2.1343
16/16 [==============================] - 0s 637us/step - loss: 2.1262
16/16 [==============================] - 0s 1ms/step - loss: 2.1229

Testing for epoch 34 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1957
16/16 [==============================] - 0s 1ms/step - loss: 1.7630
16/16 [==============================] - 0s 1ms/step - loss: 2.1149
16/16 [==============================] - 0s 1ms/step - loss: 2.2172
16/16 [==============================] - 0s 1ms/step - loss: 2.2101
16/16 [==============================] - 0s 785us/step - loss: 2.1867
16/16 [==============================] - 0s 767us/step - loss: 2.1611
16/16 [==============================] - 0s 1ms/step - loss: 2.1384
16/16 [==============================] - 0s 1ms/step - loss: 2.1303
16/16 [==============================] - 0s 835us/step - loss: 2.1270
Epoch 35 of 60

Testing for epoch 35 index 1:
16/16 [==============================] - 0s 659us/step - loss: 0.1958
16/16 [==============================] - 0s 636us/step - loss: 1.7773
16/16 [==============================] - 0s 580us/step - loss: 2.1316
16/16 [==============================] - 0s 632us/step - loss: 2.2359
16/16 [==============================] - 0s 699us/step - loss: 2.2285
16/16 [==============================] - 0s 642us/step - loss: 2.2029
16/16 [==============================] - 0s 953us/step - loss: 2.1759
16/16 [==============================] - 0s 1ms/step - loss: 2.1522
16/16 [==============================] - 0s 1ms/step - loss: 2.1437
16/16 [==============================] - 0s 843us/step - loss: 2.1402

Testing for epoch 35 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1914
16/16 [==============================] - 0s 908us/step - loss: 1.7573
16/16 [==============================] - 0s 718us/step - loss: 2.1000
16/16 [==============================] - 0s 1ms/step - loss: 2.1991
16/16 [==============================] - 0s 626us/step - loss: 2.1890
16/16 [==============================] - 0s 746us/step - loss: 2.1621
16/16 [==============================] - 0s 649us/step - loss: 2.1343
16/16 [==============================] - 0s 653us/step - loss: 2.1108
16/16 [==============================] - 0s 1ms/step - loss: 2.1026
16/16 [==============================] - 0s 1ms/step - loss: 2.0992

Testing for epoch 35 index 3:
16/16 [==============================] - 0s 615us/step - loss: 0.1948
16/16 [==============================] - 0s 637us/step - loss: 1.8010
16/16 [==============================] - 0s 1ms/step - loss: 2.1603
16/16 [==============================] - 0s 628us/step - loss: 2.2660
16/16 [==============================] - 0s 1ms/step - loss: 2.2587
16/16 [==============================] - 0s 706us/step - loss: 2.2337
16/16 [==============================] - 0s 637us/step - loss: 2.2068
16/16 [==============================] - 0s 631us/step - loss: 2.1834
16/16 [==============================] - 0s 1ms/step - loss: 2.1750
16/16 [==============================] - 0s 1ms/step - loss: 2.1716

Testing for epoch 35 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1911
16/16 [==============================] - 0s 641us/step - loss: 1.7696
16/16 [==============================] - 0s 841us/step - loss: 2.1178
16/16 [==============================] - 0s 778us/step - loss: 2.2186
16/16 [==============================] - 0s 1ms/step - loss: 2.2089
16/16 [==============================] - 0s 1ms/step - loss: 2.1826
16/16 [==============================] - 0s 1ms/step - loss: 2.1555
16/16 [==============================] - 0s 1ms/step - loss: 2.1326
16/16 [==============================] - 0s 1ms/step - loss: 2.1245
16/16 [==============================] - 0s 1ms/step - loss: 2.1212

Testing for epoch 35 index 5:
16/16 [==============================] - 0s 728us/step - loss: 0.1921
16/16 [==============================] - 0s 635us/step - loss: 1.8098
16/16 [==============================] - 0s 1ms/step - loss: 2.1669
16/16 [==============================] - 0s 661us/step - loss: 2.2703
16/16 [==============================] - 0s 1ms/step - loss: 2.2623
16/16 [==============================] - 0s 664us/step - loss: 2.2363
16/16 [==============================] - 0s 650us/step - loss: 2.2087
16/16 [==============================] - 0s 648us/step - loss: 2.1849
16/16 [==============================] - 0s 642us/step - loss: 2.1766
16/16 [==============================] - 0s 662us/step - loss: 2.1732
Epoch 36 of 60

Testing for epoch 36 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1943
16/16 [==============================] - 0s 873us/step - loss: 1.7990
16/16 [==============================] - 0s 1ms/step - loss: 2.1590
16/16 [==============================] - 0s 1ms/step - loss: 2.2620
16/16 [==============================] - 0s 1ms/step - loss: 2.2528
16/16 [==============================] - 0s 600us/step - loss: 2.2259
16/16 [==============================] - 0s 584us/step - loss: 2.1981
16/16 [==============================] - 0s 1ms/step - loss: 2.1742
16/16 [==============================] - 0s 1ms/step - loss: 2.1658
16/16 [==============================] - 0s 1ms/step - loss: 2.1623

Testing for epoch 36 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1929
16/16 [==============================] - 0s 1ms/step - loss: 1.7656
16/16 [==============================] - 0s 784us/step - loss: 2.1149
16/16 [==============================] - 0s 619us/step - loss: 2.2138
16/16 [==============================] - 0s 587us/step - loss: 2.2056
16/16 [==============================] - 0s 590us/step - loss: 2.1795
16/16 [==============================] - 0s 567us/step - loss: 2.1526
16/16 [==============================] - 0s 616us/step - loss: 2.1299
16/16 [==============================] - 0s 1ms/step - loss: 2.1219
16/16 [==============================] - 0s 594us/step - loss: 2.1186

Testing for epoch 36 index 3:
16/16 [==============================] - 0s 761us/step - loss: 0.1915
16/16 [==============================] - 0s 1ms/step - loss: 1.7777
16/16 [==============================] - 0s 1ms/step - loss: 2.1276
16/16 [==============================] - 0s 1ms/step - loss: 2.2233
16/16 [==============================] - 0s 1ms/step - loss: 2.2119
16/16 [==============================] - 0s 1ms/step - loss: 2.1831
16/16 [==============================] - 0s 1ms/step - loss: 2.1549
16/16 [==============================] - 0s 1ms/step - loss: 2.1315
16/16 [==============================] - 0s 1ms/step - loss: 2.1235
16/16 [==============================] - 0s 1ms/step - loss: 2.1202

Testing for epoch 36 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1890
16/16 [==============================] - 0s 947us/step - loss: 1.7926
16/16 [==============================] - 0s 1ms/step - loss: 2.1436
16/16 [==============================] - 0s 1ms/step - loss: 2.2395
16/16 [==============================] - 0s 625us/step - loss: 2.2279
16/16 [==============================] - 0s 1ms/step - loss: 2.1978
16/16 [==============================] - 0s 1ms/step - loss: 2.1692
16/16 [==============================] - 0s 1ms/step - loss: 2.1451
16/16 [==============================] - 0s 1ms/step - loss: 2.1368
16/16 [==============================] - 0s 1ms/step - loss: 2.1334

Testing for epoch 36 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1867
16/16 [==============================] - 0s 1ms/step - loss: 1.8739
16/16 [==============================] - 0s 1ms/step - loss: 2.2491
16/16 [==============================] - 0s 992us/step - loss: 2.3538
16/16 [==============================] - 0s 1ms/step - loss: 2.3422
16/16 [==============================] - 0s 870us/step - loss: 2.3119
16/16 [==============================] - 0s 1ms/step - loss: 2.2828
16/16 [==============================] - 0s 627us/step - loss: 2.2576
16/16 [==============================] - 0s 615us/step - loss: 2.2488
16/16 [==============================] - 0s 748us/step - loss: 2.2452
Epoch 37 of 60

Testing for epoch 37 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1852
16/16 [==============================] - 0s 725us/step - loss: 1.8347
16/16 [==============================] - 0s 646us/step - loss: 2.1942
16/16 [==============================] - 0s 856us/step - loss: 2.2953
16/16 [==============================] - 0s 661us/step - loss: 2.2842
16/16 [==============================] - 0s 604us/step - loss: 2.2557
16/16 [==============================] - 0s 602us/step - loss: 2.2280
16/16 [==============================] - 0s 908us/step - loss: 2.2039
16/16 [==============================] - 0s 1ms/step - loss: 2.1955
16/16 [==============================] - 0s 1ms/step - loss: 2.1921

Testing for epoch 37 index 2:
16/16 [==============================] - 0s 896us/step - loss: 0.1867
16/16 [==============================] - 0s 668us/step - loss: 1.7861
16/16 [==============================] - 0s 1ms/step - loss: 2.1329
16/16 [==============================] - 0s 777us/step - loss: 2.2272
16/16 [==============================] - 0s 1ms/step - loss: 2.2136
16/16 [==============================] - 0s 736us/step - loss: 2.1838
16/16 [==============================] - 0s 606us/step - loss: 2.1556
16/16 [==============================] - 0s 1ms/step - loss: 2.1315
16/16 [==============================] - 0s 1ms/step - loss: 2.1232
16/16 [==============================] - 0s 626us/step - loss: 2.1198

Testing for epoch 37 index 3:
16/16 [==============================] - 0s 579us/step - loss: 0.1835
16/16 [==============================] - 0s 1ms/step - loss: 1.8104
16/16 [==============================] - 0s 1ms/step - loss: 2.1585
16/16 [==============================] - 0s 634us/step - loss: 2.2523
16/16 [==============================] - 0s 702us/step - loss: 2.2377
16/16 [==============================] - 0s 635us/step - loss: 2.2062
16/16 [==============================] - 0s 604us/step - loss: 2.1763
16/16 [==============================] - 0s 1ms/step - loss: 2.1511
16/16 [==============================] - 0s 1ms/step - loss: 2.1427
16/16 [==============================] - 0s 625us/step - loss: 2.1392

Testing for epoch 37 index 4:
16/16 [==============================] - 0s 613us/step - loss: 0.1853
16/16 [==============================] - 0s 700us/step - loss: 1.8215
16/16 [==============================] - 0s 1ms/step - loss: 2.1727
16/16 [==============================] - 0s 723us/step - loss: 2.2672
16/16 [==============================] - 0s 714us/step - loss: 2.2522
16/16 [==============================] - 0s 621us/step - loss: 2.2214
16/16 [==============================] - 0s 669us/step - loss: 2.1932
16/16 [==============================] - 0s 607us/step - loss: 2.1690
16/16 [==============================] - 0s 700us/step - loss: 2.1607
16/16 [==============================] - 0s 651us/step - loss: 2.1573

Testing for epoch 37 index 5:
16/16 [==============================] - 0s 628us/step - loss: 0.1840
16/16 [==============================] - 0s 600us/step - loss: 1.8633
16/16 [==============================] - 0s 622us/step - loss: 2.2307
16/16 [==============================] - 0s 620us/step - loss: 2.3265
16/16 [==============================] - 0s 622us/step - loss: 2.3089
16/16 [==============================] - 0s 652us/step - loss: 2.2739
16/16 [==============================] - 0s 1ms/step - loss: 2.2421
16/16 [==============================] - 0s 968us/step - loss: 2.2152
16/16 [==============================] - 0s 1ms/step - loss: 2.2061
16/16 [==============================] - 0s 851us/step - loss: 2.2024
Epoch 38 of 60

Testing for epoch 38 index 1:
16/16 [==============================] - 0s 639us/step - loss: 0.1830
16/16 [==============================] - 0s 1ms/step - loss: 1.8733
16/16 [==============================] - 0s 621us/step - loss: 2.2434
16/16 [==============================] - 0s 966us/step - loss: 2.3381
16/16 [==============================] - 0s 1ms/step - loss: 2.3205
16/16 [==============================] - 0s 1ms/step - loss: 2.2861
16/16 [==============================] - 0s 1ms/step - loss: 2.2544
16/16 [==============================] - 0s 1ms/step - loss: 2.2276
16/16 [==============================] - 0s 936us/step - loss: 2.2186
16/16 [==============================] - 0s 617us/step - loss: 2.2149

Testing for epoch 38 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1816
16/16 [==============================] - 0s 618us/step - loss: 1.8904
16/16 [==============================] - 0s 1ms/step - loss: 2.2667
16/16 [==============================] - 0s 707us/step - loss: 2.3649
16/16 [==============================] - 0s 1ms/step - loss: 2.3499
16/16 [==============================] - 0s 1ms/step - loss: 2.3184
16/16 [==============================] - 0s 1ms/step - loss: 2.2894
16/16 [==============================] - 0s 1ms/step - loss: 2.2641
16/16 [==============================] - 0s 1ms/step - loss: 2.2555
16/16 [==============================] - 0s 632us/step - loss: 2.2520

Testing for epoch 38 index 3:
16/16 [==============================] - 0s 607us/step - loss: 0.1833
16/16 [==============================] - 0s 641us/step - loss: 1.8758
16/16 [==============================] - 0s 1ms/step - loss: 2.2495
16/16 [==============================] - 0s 617us/step - loss: 2.3460
16/16 [==============================] - 0s 639us/step - loss: 2.3310
16/16 [==============================] - 0s 930us/step - loss: 2.2983
16/16 [==============================] - 0s 622us/step - loss: 2.2679
16/16 [==============================] - 0s 1ms/step - loss: 2.2418
16/16 [==============================] - 0s 624us/step - loss: 2.2328
16/16 [==============================] - 0s 1ms/step - loss: 2.2291

Testing for epoch 38 index 4:
16/16 [==============================] - 0s 969us/step - loss: 0.1794
16/16 [==============================] - 0s 1ms/step - loss: 1.9049
16/16 [==============================] - 0s 1ms/step - loss: 2.2851
16/16 [==============================] - 0s 615us/step - loss: 2.3832
16/16 [==============================] - 0s 712us/step - loss: 2.3669
16/16 [==============================] - 0s 616us/step - loss: 2.3326
16/16 [==============================] - 0s 1ms/step - loss: 2.3017
16/16 [==============================] - 0s 630us/step - loss: 2.2754
16/16 [==============================] - 0s 837us/step - loss: 2.2665
16/16 [==============================] - 0s 1ms/step - loss: 2.2628

Testing for epoch 38 index 5:
16/16 [==============================] - 0s 632us/step - loss: 0.1800
16/16 [==============================] - 0s 626us/step - loss: 1.8637
16/16 [==============================] - 0s 904us/step - loss: 2.2352
16/16 [==============================] - 0s 1ms/step - loss: 2.3308
16/16 [==============================] - 0s 1ms/step - loss: 2.3141
16/16 [==============================] - 0s 1ms/step - loss: 2.2801
16/16 [==============================] - 0s 1ms/step - loss: 2.2488
16/16 [==============================] - 0s 1ms/step - loss: 2.2227
16/16 [==============================] - 0s 919us/step - loss: 2.2139
16/16 [==============================] - 0s 966us/step - loss: 2.2103
Epoch 39 of 60

Testing for epoch 39 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1775
16/16 [==============================] - 0s 644us/step - loss: 1.9059
16/16 [==============================] - 0s 669us/step - loss: 2.2860
16/16 [==============================] - 0s 1ms/step - loss: 2.3835
16/16 [==============================] - 0s 664us/step - loss: 2.3656
16/16 [==============================] - 0s 1ms/step - loss: 2.3309
16/16 [==============================] - 0s 689us/step - loss: 2.2992
16/16 [==============================] - 0s 1ms/step - loss: 2.2725
16/16 [==============================] - 0s 1ms/step - loss: 2.2635
16/16 [==============================] - 0s 1ms/step - loss: 2.2598

Testing for epoch 39 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1770
16/16 [==============================] - 0s 882us/step - loss: 1.8485
16/16 [==============================] - 0s 1ms/step - loss: 2.2087
16/16 [==============================] - 0s 843us/step - loss: 2.3001
16/16 [==============================] - 0s 1ms/step - loss: 2.2820
16/16 [==============================] - 0s 1ms/step - loss: 2.2470
16/16 [==============================] - 0s 808us/step - loss: 2.2158
16/16 [==============================] - 0s 674us/step - loss: 2.1898
16/16 [==============================] - 0s 665us/step - loss: 2.1810
16/16 [==============================] - 0s 666us/step - loss: 2.1774

Testing for epoch 39 index 3:
16/16 [==============================] - 0s 702us/step - loss: 0.1778
16/16 [==============================] - 0s 1ms/step - loss: 1.8604
16/16 [==============================] - 0s 1ms/step - loss: 2.2199
16/16 [==============================] - 0s 1ms/step - loss: 2.3081
16/16 [==============================] - 0s 1ms/step - loss: 2.2886
16/16 [==============================] - 0s 1ms/step - loss: 2.2537
16/16 [==============================] - 0s 899us/step - loss: 2.2230
16/16 [==============================] - 0s 847us/step - loss: 2.1975
16/16 [==============================] - 0s 674us/step - loss: 2.1890
16/16 [==============================] - 0s 648us/step - loss: 2.1856

Testing for epoch 39 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1772
16/16 [==============================] - 0s 1ms/step - loss: 1.9029
16/16 [==============================] - 0s 1ms/step - loss: 2.2795
16/16 [==============================] - 0s 929us/step - loss: 2.3721
16/16 [==============================] - 0s 656us/step - loss: 2.3526
16/16 [==============================] - 0s 685us/step - loss: 2.3171
16/16 [==============================] - 0s 697us/step - loss: 2.2856
16/16 [==============================] - 0s 686us/step - loss: 2.2594
16/16 [==============================] - 0s 1ms/step - loss: 2.2505
16/16 [==============================] - 0s 938us/step - loss: 2.2469

Testing for epoch 39 index 5:
16/16 [==============================] - 0s 736us/step - loss: 0.1773
16/16 [==============================] - 0s 1ms/step - loss: 1.8690
16/16 [==============================] - 0s 1ms/step - loss: 2.2337
16/16 [==============================] - 0s 997us/step - loss: 2.3199
16/16 [==============================] - 0s 1ms/step - loss: 2.2990
16/16 [==============================] - 0s 965us/step - loss: 2.2626
16/16 [==============================] - 0s 1ms/step - loss: 2.2305
16/16 [==============================] - 0s 681us/step - loss: 2.2046
16/16 [==============================] - 0s 701us/step - loss: 2.1959
16/16 [==============================] - 0s 684us/step - loss: 2.1924
Epoch 40 of 60

Testing for epoch 40 index 1:
16/16 [==============================] - 0s 857us/step - loss: 0.1749
16/16 [==============================] - 0s 647us/step - loss: 1.8422
16/16 [==============================] - 0s 695us/step - loss: 2.2055
16/16 [==============================] - 0s 1ms/step - loss: 2.2933
16/16 [==============================] - 0s 858us/step - loss: 2.2752
16/16 [==============================] - 0s 1ms/step - loss: 2.2414
16/16 [==============================] - 0s 1ms/step - loss: 2.2106
16/16 [==============================] - 0s 702us/step - loss: 2.1853
16/16 [==============================] - 0s 1ms/step - loss: 2.1768
16/16 [==============================] - 0s 653us/step - loss: 2.1733

Testing for epoch 40 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 0.1735
16/16 [==============================] - 0s 2ms/step - loss: 1.8843
16/16 [==============================] - 0s 2ms/step - loss: 2.2440
16/16 [==============================] - 0s 2ms/step - loss: 2.3291
16/16 [==============================] - 0s 2ms/step - loss: 2.3069
16/16 [==============================] - 0s 2ms/step - loss: 2.2710
16/16 [==============================] - 0s 2ms/step - loss: 2.2398
16/16 [==============================] - 0s 2ms/step - loss: 2.2144
16/16 [==============================] - 0s 2ms/step - loss: 2.2058
16/16 [==============================] - 0s 1ms/step - loss: 2.2023

Testing for epoch 40 index 3:
16/16 [==============================] - 0s 776us/step - loss: 0.1737
16/16 [==============================] - 0s 2ms/step - loss: 1.8765
16/16 [==============================] - 0s 2ms/step - loss: 2.2332
16/16 [==============================] - 0s 2ms/step - loss: 2.3172
16/16 [==============================] - 0s 2ms/step - loss: 2.2945
16/16 [==============================] - 0s 2ms/step - loss: 2.2569
16/16 [==============================] - 0s 3ms/step - loss: 2.2234
16/16 [==============================] - 0s 2ms/step - loss: 2.1967
16/16 [==============================] - 0s 2ms/step - loss: 2.1880
16/16 [==============================] - 0s 2ms/step - loss: 2.1844

Testing for epoch 40 index 4:
16/16 [==============================] - 0s 2ms/step - loss: 0.1761
16/16 [==============================] - 0s 716us/step - loss: 1.8934
16/16 [==============================] - 0s 703us/step - loss: 2.2560
16/16 [==============================] - 0s 675us/step - loss: 2.3469
16/16 [==============================] - 0s 683us/step - loss: 2.3263
16/16 [==============================] - 0s 735us/step - loss: 2.2914
16/16 [==============================] - 0s 2ms/step - loss: 2.2595
16/16 [==============================] - 0s 2ms/step - loss: 2.2333
16/16 [==============================] - 0s 2ms/step - loss: 2.2245
16/16 [==============================] - 0s 1ms/step - loss: 2.2209

Testing for epoch 40 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1722
16/16 [==============================] - 0s 2ms/step - loss: 1.9280
16/16 [==============================] - 0s 1ms/step - loss: 2.2976
16/16 [==============================] - 0s 1ms/step - loss: 2.3871
16/16 [==============================] - 0s 1ms/step - loss: 2.3629
16/16 [==============================] - 0s 1ms/step - loss: 2.3248
16/16 [==============================] - 0s 2ms/step - loss: 2.2908
16/16 [==============================] - 0s 1ms/step - loss: 2.2634
16/16 [==============================] - 0s 2ms/step - loss: 2.2542
16/16 [==============================] - 0s 2ms/step - loss: 2.2505
Epoch 41 of 60

Testing for epoch 41 index 1:
16/16 [==============================] - 0s 665us/step - loss: 0.1699
16/16 [==============================] - 0s 649us/step - loss: 1.9410
16/16 [==============================] - 0s 642us/step - loss: 2.3137
16/16 [==============================] - 0s 647us/step - loss: 2.4031
16/16 [==============================] - 0s 634us/step - loss: 2.3771
16/16 [==============================] - 0s 655us/step - loss: 2.3376
16/16 [==============================] - 0s 2ms/step - loss: 2.3020
16/16 [==============================] - 0s 1ms/step - loss: 2.2737
16/16 [==============================] - 0s 670us/step - loss: 2.2643
16/16 [==============================] - 0s 643us/step - loss: 2.2604

Testing for epoch 41 index 2:
16/16 [==============================] - 0s 629us/step - loss: 0.1723
16/16 [==============================] - 0s 2ms/step - loss: 1.8916
16/16 [==============================] - 0s 807us/step - loss: 2.2597
16/16 [==============================] - 0s 933us/step - loss: 2.3476
16/16 [==============================] - 0s 933us/step - loss: 2.3238
16/16 [==============================] - 0s 923us/step - loss: 2.2886
16/16 [==============================] - 0s 952us/step - loss: 2.2566
16/16 [==============================] - 0s 1ms/step - loss: 2.2308
16/16 [==============================] - 0s 995us/step - loss: 2.2222
16/16 [==============================] - 0s 911us/step - loss: 2.2188

Testing for epoch 41 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1698
16/16 [==============================] - 0s 2ms/step - loss: 1.9182
16/16 [==============================] - 0s 1ms/step - loss: 2.2868
16/16 [==============================] - 0s 755us/step - loss: 2.3684
16/16 [==============================] - 0s 652us/step - loss: 2.3398
16/16 [==============================] - 0s 650us/step - loss: 2.3013
16/16 [==============================] - 0s 648us/step - loss: 2.2666
16/16 [==============================] - 0s 660us/step - loss: 2.2391
16/16 [==============================] - 0s 1ms/step - loss: 2.2300
16/16 [==============================] - 0s 2ms/step - loss: 2.2264

Testing for epoch 41 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1686
16/16 [==============================] - 0s 648us/step - loss: 1.9577
16/16 [==============================] - 0s 887us/step - loss: 2.3428
16/16 [==============================] - 0s 1ms/step - loss: 2.4313
16/16 [==============================] - 0s 645us/step - loss: 2.4052
16/16 [==============================] - 0s 1ms/step - loss: 2.3674
16/16 [==============================] - 0s 2ms/step - loss: 2.3327
16/16 [==============================] - 0s 653us/step - loss: 2.3051
16/16 [==============================] - 0s 2ms/step - loss: 2.2958
16/16 [==============================] - 0s 2ms/step - loss: 2.2921

Testing for epoch 41 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1707
16/16 [==============================] - 0s 1ms/step - loss: 1.9381
16/16 [==============================] - 0s 626us/step - loss: 2.3141
16/16 [==============================] - 0s 2ms/step - loss: 2.3976
16/16 [==============================] - 0s 1ms/step - loss: 2.3711
16/16 [==============================] - 0s 2ms/step - loss: 2.3333
16/16 [==============================] - 0s 2ms/step - loss: 2.2988
16/16 [==============================] - 0s 2ms/step - loss: 2.2715
16/16 [==============================] - 0s 1ms/step - loss: 2.2624
16/16 [==============================] - 0s 2ms/step - loss: 2.2588
Epoch 42 of 60

Testing for epoch 42 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 0.1687
16/16 [==============================] - 0s 2ms/step - loss: 1.9747
16/16 [==============================] - 0s 2ms/step - loss: 2.3635
16/16 [==============================] - 0s 2ms/step - loss: 2.4468
16/16 [==============================] - 0s 2ms/step - loss: 2.4175
16/16 [==============================] - 0s 2ms/step - loss: 2.3761
16/16 [==============================] - 0s 1ms/step - loss: 2.3383
16/16 [==============================] - 0s 2ms/step - loss: 2.3088
16/16 [==============================] - 0s 1ms/step - loss: 2.2990
16/16 [==============================] - 0s 2ms/step - loss: 2.2950

Testing for epoch 42 index 2:
16/16 [==============================] - 0s 2ms/step - loss: 0.1671
16/16 [==============================] - 0s 1ms/step - loss: 1.9391
16/16 [==============================] - 0s 2ms/step - loss: 2.3156
16/16 [==============================] - 0s 1ms/step - loss: 2.3979
16/16 [==============================] - 0s 2ms/step - loss: 2.3719
16/16 [==============================] - 0s 2ms/step - loss: 2.3335
16/16 [==============================] - 0s 2ms/step - loss: 2.2984
16/16 [==============================] - 0s 2ms/step - loss: 2.2707
16/16 [==============================] - 0s 2ms/step - loss: 2.2614
16/16 [==============================] - 0s 2ms/step - loss: 2.2577

Testing for epoch 42 index 3:
16/16 [==============================] - 0s 2ms/step - loss: 0.1662
16/16 [==============================] - 0s 1ms/step - loss: 1.9564
16/16 [==============================] - 0s 1ms/step - loss: 2.3366
16/16 [==============================] - 0s 2ms/step - loss: 2.4170
16/16 [==============================] - 0s 2ms/step - loss: 2.3906
16/16 [==============================] - 0s 2ms/step - loss: 2.3517
16/16 [==============================] - 0s 1ms/step - loss: 2.3168
16/16 [==============================] - 0s 1ms/step - loss: 2.2891
16/16 [==============================] - 0s 2ms/step - loss: 2.2799
16/16 [==============================] - 0s 3ms/step - loss: 2.2762

Testing for epoch 42 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1664
16/16 [==============================] - 0s 836us/step - loss: 1.9228
16/16 [==============================] - 0s 857us/step - loss: 2.2967
16/16 [==============================] - 0s 827us/step - loss: 2.3769
16/16 [==============================] - 0s 2ms/step - loss: 2.3522
16/16 [==============================] - 0s 2ms/step - loss: 2.3146
16/16 [==============================] - 0s 2ms/step - loss: 2.2804
16/16 [==============================] - 0s 2ms/step - loss: 2.2535
16/16 [==============================] - 0s 2ms/step - loss: 2.2446
16/16 [==============================] - 0s 2ms/step - loss: 2.2410

Testing for epoch 42 index 5:
16/16 [==============================] - 0s 968us/step - loss: 0.1647
16/16 [==============================] - 0s 836us/step - loss: 1.9825
16/16 [==============================] - 0s 1ms/step - loss: 2.3655
16/16 [==============================] - 0s 991us/step - loss: 2.4400
16/16 [==============================] - 0s 708us/step - loss: 2.4065
16/16 [==============================] - 0s 988us/step - loss: 2.3618
16/16 [==============================] - 0s 1ms/step - loss: 2.3236
16/16 [==============================] - 0s 769us/step - loss: 2.2942
16/16 [==============================] - 0s 630us/step - loss: 2.2846
16/16 [==============================] - 0s 832us/step - loss: 2.2808
Epoch 43 of 60

Testing for epoch 43 index 1:
16/16 [==============================] - 0s 2ms/step - loss: 0.1616
16/16 [==============================] - 0s 2ms/step - loss: 1.9799
16/16 [==============================] - 0s 2ms/step - loss: 2.3682
16/16 [==============================] - 0s 2ms/step - loss: 2.4457
16/16 [==============================] - 0s 2ms/step - loss: 2.4156
16/16 [==============================] - 0s 2ms/step - loss: 2.3727
16/16 [==============================] - 0s 2ms/step - loss: 2.3349
16/16 [==============================] - 0s 2ms/step - loss: 2.3056
16/16 [==============================] - 0s 2ms/step - loss: 2.2959
16/16 [==============================] - 0s 2ms/step - loss: 2.2921

Testing for epoch 43 index 2:
16/16 [==============================] - 0s 594us/step - loss: 0.1670
16/16 [==============================] - 0s 542us/step - loss: 1.9252
16/16 [==============================] - 0s 603us/step - loss: 2.3035
16/16 [==============================] - 0s 638us/step - loss: 2.3810
16/16 [==============================] - 0s 646us/step - loss: 2.3532
16/16 [==============================] - 0s 490us/step - loss: 2.3132
16/16 [==============================] - 0s 517us/step - loss: 2.2779
16/16 [==============================] - 0s 1ms/step - loss: 2.2503
16/16 [==============================] - 0s 895us/step - loss: 2.2412
16/16 [==============================] - 0s 570us/step - loss: 2.2376

Testing for epoch 43 index 3:
16/16 [==============================] - 0s 626us/step - loss: 0.1649
16/16 [==============================] - 0s 921us/step - loss: 1.9655
16/16 [==============================] - 0s 1ms/step - loss: 2.3495
16/16 [==============================] - 0s 708us/step - loss: 2.4250
16/16 [==============================] - 0s 1ms/step - loss: 2.3950
16/16 [==============================] - 0s 1ms/step - loss: 2.3532
16/16 [==============================] - 0s 681us/step - loss: 2.3167
16/16 [==============================] - 0s 632us/step - loss: 2.2886
16/16 [==============================] - 0s 1ms/step - loss: 2.2794
16/16 [==============================] - 0s 644us/step - loss: 2.2756

Testing for epoch 43 index 4:
16/16 [==============================] - 0s 716us/step - loss: 0.1628
16/16 [==============================] - 0s 631us/step - loss: 1.9172
16/16 [==============================] - 0s 634us/step - loss: 2.2852
16/16 [==============================] - 0s 601us/step - loss: 2.3543
16/16 [==============================] - 0s 1ms/step - loss: 2.3241
16/16 [==============================] - 0s 1ms/step - loss: 2.2817
16/16 [==============================] - 0s 1ms/step - loss: 2.2446
16/16 [==============================] - 0s 637us/step - loss: 2.2162
16/16 [==============================] - 0s 1ms/step - loss: 2.2068
16/16 [==============================] - 0s 622us/step - loss: 2.2031

Testing for epoch 43 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1632
16/16 [==============================] - 0s 614us/step - loss: 1.9494
16/16 [==============================] - 0s 585us/step - loss: 2.3248
16/16 [==============================] - 0s 1ms/step - loss: 2.3958
16/16 [==============================] - 0s 605us/step - loss: 2.3639
16/16 [==============================] - 0s 1ms/step - loss: 2.3212
16/16 [==============================] - 0s 659us/step - loss: 2.2846
16/16 [==============================] - 0s 920us/step - loss: 2.2564
16/16 [==============================] - 0s 642us/step - loss: 2.2472
16/16 [==============================] - 0s 1ms/step - loss: 2.2436
Epoch 44 of 60

Testing for epoch 44 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1623
16/16 [==============================] - 0s 632us/step - loss: 1.9453
16/16 [==============================] - 0s 701us/step - loss: 2.3227
16/16 [==============================] - 0s 1ms/step - loss: 2.3937
16/16 [==============================] - 0s 598us/step - loss: 2.3616
16/16 [==============================] - 0s 623us/step - loss: 2.3172
16/16 [==============================] - 0s 1ms/step - loss: 2.2785
16/16 [==============================] - 0s 802us/step - loss: 2.2493
16/16 [==============================] - 0s 1ms/step - loss: 2.2398
16/16 [==============================] - 0s 900us/step - loss: 2.2360

Testing for epoch 44 index 2:
16/16 [==============================] - 0s 639us/step - loss: 0.1612
16/16 [==============================] - 0s 709us/step - loss: 1.9442
16/16 [==============================] - 0s 617us/step - loss: 2.3257
16/16 [==============================] - 0s 598us/step - loss: 2.4020
16/16 [==============================] - 0s 1ms/step - loss: 2.3753
16/16 [==============================] - 0s 625us/step - loss: 2.3369
16/16 [==============================] - 0s 611us/step - loss: 2.3024
16/16 [==============================] - 0s 601us/step - loss: 2.2753
16/16 [==============================] - 0s 764us/step - loss: 2.2663
16/16 [==============================] - 0s 1ms/step - loss: 2.2626

Testing for epoch 44 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1585
16/16 [==============================] - 0s 1ms/step - loss: 2.0528
16/16 [==============================] - 0s 609us/step - loss: 2.4585
16/16 [==============================] - 0s 789us/step - loss: 2.5358
16/16 [==============================] - 0s 587us/step - loss: 2.5023
16/16 [==============================] - 0s 672us/step - loss: 2.4563
16/16 [==============================] - 0s 805us/step - loss: 2.4162
16/16 [==============================] - 0s 1ms/step - loss: 2.3857
16/16 [==============================] - 0s 1ms/step - loss: 2.3757
16/16 [==============================] - 0s 1ms/step - loss: 2.3718

Testing for epoch 44 index 4:
16/16 [==============================] - 0s 735us/step - loss: 0.1614
16/16 [==============================] - 0s 1ms/step - loss: 2.0477
16/16 [==============================] - 0s 646us/step - loss: 2.4531
16/16 [==============================] - 0s 1ms/step - loss: 2.5273
16/16 [==============================] - 0s 560us/step - loss: 2.4941
16/16 [==============================] - 0s 604us/step - loss: 2.4496
16/16 [==============================] - 0s 1ms/step - loss: 2.4104
16/16 [==============================] - 0s 599us/step - loss: 2.3801
16/16 [==============================] - 0s 1ms/step - loss: 2.3702
16/16 [==============================] - 0s 1ms/step - loss: 2.3661

Testing for epoch 44 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1584
16/16 [==============================] - 0s 1ms/step - loss: 2.0297
16/16 [==============================] - 0s 1ms/step - loss: 2.4309
16/16 [==============================] - 0s 1ms/step - loss: 2.5028
16/16 [==============================] - 0s 844us/step - loss: 2.4704
16/16 [==============================] - 0s 721us/step - loss: 2.4258
16/16 [==============================] - 0s 1ms/step - loss: 2.3870
16/16 [==============================] - 0s 724us/step - loss: 2.3575
16/16 [==============================] - 0s 1ms/step - loss: 2.3479
16/16 [==============================] - 0s 1ms/step - loss: 2.3440
Epoch 45 of 60

Testing for epoch 45 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1607
16/16 [==============================] - 0s 1ms/step - loss: 1.9936
16/16 [==============================] - 0s 1ms/step - loss: 2.3817
16/16 [==============================] - 0s 618us/step - loss: 2.4495
16/16 [==============================] - 0s 1ms/step - loss: 2.4171
16/16 [==============================] - 0s 1ms/step - loss: 2.3735
16/16 [==============================] - 0s 929us/step - loss: 2.3355
16/16 [==============================] - 0s 1ms/step - loss: 2.3067
16/16 [==============================] - 0s 1ms/step - loss: 2.2974
16/16 [==============================] - 0s 967us/step - loss: 2.2937

Testing for epoch 45 index 2:
16/16 [==============================] - 0s 625us/step - loss: 0.1592
16/16 [==============================] - 0s 748us/step - loss: 2.0080
16/16 [==============================] - 0s 948us/step - loss: 2.3934
16/16 [==============================] - 0s 626us/step - loss: 2.4562
16/16 [==============================] - 0s 1ms/step - loss: 2.4202
16/16 [==============================] - 0s 1ms/step - loss: 2.3733
16/16 [==============================] - 0s 600us/step - loss: 2.3338
16/16 [==============================] - 0s 1ms/step - loss: 2.3041
16/16 [==============================] - 0s 1ms/step - loss: 2.2945
16/16 [==============================] - 0s 579us/step - loss: 2.2907

Testing for epoch 45 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1563
16/16 [==============================] - 0s 1ms/step - loss: 1.9989
16/16 [==============================] - 0s 791us/step - loss: 2.3823
16/16 [==============================] - 0s 592us/step - loss: 2.4454
16/16 [==============================] - 0s 657us/step - loss: 2.4112
16/16 [==============================] - 0s 731us/step - loss: 2.3670
16/16 [==============================] - 0s 1ms/step - loss: 2.3288
16/16 [==============================] - 0s 745us/step - loss: 2.2995
16/16 [==============================] - 0s 595us/step - loss: 2.2900
16/16 [==============================] - 0s 629us/step - loss: 2.2862

Testing for epoch 45 index 4:
16/16 [==============================] - 0s 948us/step - loss: 0.1570
16/16 [==============================] - 0s 860us/step - loss: 1.9843
16/16 [==============================] - 0s 836us/step - loss: 2.3656
16/16 [==============================] - 0s 1ms/step - loss: 2.4254
16/16 [==============================] - 0s 1ms/step - loss: 2.3894
16/16 [==============================] - 0s 1ms/step - loss: 2.3424
16/16 [==============================] - 0s 644us/step - loss: 2.3025
16/16 [==============================] - 0s 606us/step - loss: 2.2727
16/16 [==============================] - 0s 1ms/step - loss: 2.2631
16/16 [==============================] - 0s 810us/step - loss: 2.2593

Testing for epoch 45 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1540
16/16 [==============================] - 0s 621us/step - loss: 2.0578
16/16 [==============================] - 0s 754us/step - loss: 2.4644
16/16 [==============================] - 0s 1ms/step - loss: 2.5294
16/16 [==============================] - 0s 1ms/step - loss: 2.4946
16/16 [==============================] - 0s 1ms/step - loss: 2.4481
16/16 [==============================] - 0s 1ms/step - loss: 2.4079
16/16 [==============================] - 0s 759us/step - loss: 2.3773
16/16 [==============================] - 0s 1ms/step - loss: 2.3674
16/16 [==============================] - 0s 634us/step - loss: 2.3635
Epoch 46 of 60

Testing for epoch 46 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1569
16/16 [==============================] - 0s 624us/step - loss: 2.0009
16/16 [==============================] - 0s 644us/step - loss: 2.3983
16/16 [==============================] - 0s 620us/step - loss: 2.4650
16/16 [==============================] - 0s 1ms/step - loss: 2.4337
16/16 [==============================] - 0s 657us/step - loss: 2.3895
16/16 [==============================] - 0s 662us/step - loss: 2.3506
16/16 [==============================] - 0s 1ms/step - loss: 2.3207
16/16 [==============================] - 0s 826us/step - loss: 2.3109
16/16 [==============================] - 0s 1ms/step - loss: 2.3070

Testing for epoch 46 index 2:
16/16 [==============================] - 0s 648us/step - loss: 0.1564
16/16 [==============================] - 0s 906us/step - loss: 1.9920
16/16 [==============================] - 0s 1ms/step - loss: 2.3850
16/16 [==============================] - 0s 632us/step - loss: 2.4473
16/16 [==============================] - 0s 914us/step - loss: 2.4129
16/16 [==============================] - 0s 650us/step - loss: 2.3665
16/16 [==============================] - 0s 1ms/step - loss: 2.3262
16/16 [==============================] - 0s 1ms/step - loss: 2.2963
16/16 [==============================] - 0s 631us/step - loss: 2.2867
16/16 [==============================] - 0s 1ms/step - loss: 2.2828

Testing for epoch 46 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1523
16/16 [==============================] - 0s 610us/step - loss: 1.9810
16/16 [==============================] - 0s 1ms/step - loss: 2.3695
16/16 [==============================] - 0s 599us/step - loss: 2.4291
16/16 [==============================] - 0s 1ms/step - loss: 2.3939
16/16 [==============================] - 0s 596us/step - loss: 2.3485
16/16 [==============================] - 0s 651us/step - loss: 2.3100
16/16 [==============================] - 0s 1ms/step - loss: 2.2810
16/16 [==============================] - 0s 1ms/step - loss: 2.2716
16/16 [==============================] - 0s 789us/step - loss: 2.2678

Testing for epoch 46 index 4:
16/16 [==============================] - 0s 605us/step - loss: 0.1539
16/16 [==============================] - 0s 946us/step - loss: 2.0070
16/16 [==============================] - 0s 1ms/step - loss: 2.3983
16/16 [==============================] - 0s 562us/step - loss: 2.4547
16/16 [==============================] - 0s 1ms/step - loss: 2.4185
16/16 [==============================] - 0s 646us/step - loss: 2.3714
16/16 [==============================] - 0s 1ms/step - loss: 2.3316
16/16 [==============================] - 0s 1ms/step - loss: 2.3019
16/16 [==============================] - 0s 1ms/step - loss: 2.2923
16/16 [==============================] - 0s 629us/step - loss: 2.2885

Testing for epoch 46 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1531
16/16 [==============================] - 0s 1ms/step - loss: 2.0956
16/16 [==============================] - 0s 1ms/step - loss: 2.5234
16/16 [==============================] - 0s 649us/step - loss: 2.5872
16/16 [==============================] - 0s 1ms/step - loss: 2.5491
16/16 [==============================] - 0s 1ms/step - loss: 2.4983
16/16 [==============================] - 0s 1ms/step - loss: 2.4550
16/16 [==============================] - 0s 1ms/step - loss: 2.4226
16/16 [==============================] - 0s 1ms/step - loss: 2.4122
16/16 [==============================] - 0s 1ms/step - loss: 2.4080
Epoch 47 of 60

Testing for epoch 47 index 1:
16/16 [==============================] - 0s 631us/step - loss: 0.1539
16/16 [==============================] - 0s 877us/step - loss: 2.0259
16/16 [==============================] - 0s 1ms/step - loss: 2.4331
16/16 [==============================] - 0s 724us/step - loss: 2.4907
16/16 [==============================] - 0s 631us/step - loss: 2.4546
16/16 [==============================] - 0s 631us/step - loss: 2.4070
16/16 [==============================] - 0s 1ms/step - loss: 2.3665
16/16 [==============================] - 0s 1ms/step - loss: 2.3359
16/16 [==============================] - 0s 995us/step - loss: 2.3261
16/16 [==============================] - 0s 1ms/step - loss: 2.3222

Testing for epoch 47 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1519
16/16 [==============================] - 0s 639us/step - loss: 2.0542
16/16 [==============================] - 0s 934us/step - loss: 2.4779
16/16 [==============================] - 0s 1ms/step - loss: 2.5430
16/16 [==============================] - 0s 666us/step - loss: 2.5111
16/16 [==============================] - 0s 645us/step - loss: 2.4667
16/16 [==============================] - 0s 606us/step - loss: 2.4283
16/16 [==============================] - 0s 842us/step - loss: 2.3987
16/16 [==============================] - 0s 617us/step - loss: 2.3890
16/16 [==============================] - 0s 1ms/step - loss: 2.3851

Testing for epoch 47 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1528
16/16 [==============================] - 0s 957us/step - loss: 2.0201
16/16 [==============================] - 0s 1ms/step - loss: 2.4226
16/16 [==============================] - 0s 610us/step - loss: 2.4747
16/16 [==============================] - 0s 626us/step - loss: 2.4384
16/16 [==============================] - 0s 1ms/step - loss: 2.3899
16/16 [==============================] - 0s 1ms/step - loss: 2.3487
16/16 [==============================] - 0s 1ms/step - loss: 2.3181
16/16 [==============================] - 0s 1ms/step - loss: 2.3083
16/16 [==============================] - 0s 635us/step - loss: 2.3044

Testing for epoch 47 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1513
16/16 [==============================] - 0s 1ms/step - loss: 2.0221
16/16 [==============================] - 0s 953us/step - loss: 2.4286
16/16 [==============================] - 0s 584us/step - loss: 2.4816
16/16 [==============================] - 0s 794us/step - loss: 2.4463
16/16 [==============================] - 0s 1ms/step - loss: 2.3995
16/16 [==============================] - 0s 1ms/step - loss: 2.3596
16/16 [==============================] - 0s 1ms/step - loss: 2.3298
16/16 [==============================] - 0s 635us/step - loss: 2.3202
16/16 [==============================] - 0s 1ms/step - loss: 2.3163

Testing for epoch 47 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1505
16/16 [==============================] - 0s 1ms/step - loss: 2.0238
16/16 [==============================] - 0s 1ms/step - loss: 2.4319
16/16 [==============================] - 0s 1ms/step - loss: 2.4849
16/16 [==============================] - 0s 628us/step - loss: 2.4502
16/16 [==============================] - 0s 1ms/step - loss: 2.4034
16/16 [==============================] - 0s 660us/step - loss: 2.3643
16/16 [==============================] - 0s 614us/step - loss: 2.3350
16/16 [==============================] - 0s 628us/step - loss: 2.3256
16/16 [==============================] - 0s 1ms/step - loss: 2.3218
Epoch 48 of 60

Testing for epoch 48 index 1:
16/16 [==============================] - 0s 637us/step - loss: 0.1506
16/16 [==============================] - 0s 929us/step - loss: 2.0292
16/16 [==============================] - 0s 635us/step - loss: 2.4452
16/16 [==============================] - 0s 625us/step - loss: 2.5006
16/16 [==============================] - 0s 639us/step - loss: 2.4658
16/16 [==============================] - 0s 1ms/step - loss: 2.4185
16/16 [==============================] - 0s 640us/step - loss: 2.3780
16/16 [==============================] - 0s 1ms/step - loss: 2.3475
16/16 [==============================] - 0s 593us/step - loss: 2.3377
16/16 [==============================] - 0s 947us/step - loss: 2.3338

Testing for epoch 48 index 2:
16/16 [==============================] - 0s 642us/step - loss: 0.1520
16/16 [==============================] - 0s 927us/step - loss: 2.0468
16/16 [==============================] - 0s 907us/step - loss: 2.4645
16/16 [==============================] - 0s 1ms/step - loss: 2.5202
16/16 [==============================] - 0s 721us/step - loss: 2.4857
16/16 [==============================] - 0s 1ms/step - loss: 2.4381
16/16 [==============================] - 0s 1ms/step - loss: 2.3972
16/16 [==============================] - 0s 1ms/step - loss: 2.3664
16/16 [==============================] - 0s 755us/step - loss: 2.3565
16/16 [==============================] - 0s 1ms/step - loss: 2.3525

Testing for epoch 48 index 3:
16/16 [==============================] - 0s 836us/step - loss: 0.1459
16/16 [==============================] - 0s 1ms/step - loss: 2.0895
16/16 [==============================] - 0s 1ms/step - loss: 2.5139
16/16 [==============================] - 0s 1ms/step - loss: 2.5640
16/16 [==============================] - 0s 773us/step - loss: 2.5243
16/16 [==============================] - 0s 754us/step - loss: 2.4719
16/16 [==============================] - 0s 617us/step - loss: 2.4279
16/16 [==============================] - 0s 1ms/step - loss: 2.3952
16/16 [==============================] - 0s 935us/step - loss: 2.3847
16/16 [==============================] - 0s 1ms/step - loss: 2.3804

Testing for epoch 48 index 4:
16/16 [==============================] - 0s 635us/step - loss: 0.1465
16/16 [==============================] - 0s 640us/step - loss: 2.0292
16/16 [==============================] - 0s 610us/step - loss: 2.4415
16/16 [==============================] - 0s 635us/step - loss: 2.4915
16/16 [==============================] - 0s 634us/step - loss: 2.4547
16/16 [==============================] - 0s 621us/step - loss: 2.4048
16/16 [==============================] - 0s 644us/step - loss: 2.3627
16/16 [==============================] - 0s 750us/step - loss: 2.3313
16/16 [==============================] - 0s 1ms/step - loss: 2.3213
16/16 [==============================] - 0s 705us/step - loss: 2.3173

Testing for epoch 48 index 5:
16/16 [==============================] - 0s 624us/step - loss: 0.1449
16/16 [==============================] - 0s 1ms/step - loss: 2.0603
16/16 [==============================] - 0s 1ms/step - loss: 2.4760
16/16 [==============================] - 0s 1ms/step - loss: 2.5243
16/16 [==============================] - 0s 1ms/step - loss: 2.4877
16/16 [==============================] - 0s 1ms/step - loss: 2.4388
16/16 [==============================] - 0s 1ms/step - loss: 2.3979
16/16 [==============================] - 0s 615us/step - loss: 2.3674
16/16 [==============================] - 0s 1ms/step - loss: 2.3576
16/16 [==============================] - 0s 1ms/step - loss: 2.3537
Epoch 49 of 60

Testing for epoch 49 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1456
16/16 [==============================] - 0s 1ms/step - loss: 2.1177
16/16 [==============================] - 0s 1ms/step - loss: 2.5539
16/16 [==============================] - 0s 1ms/step - loss: 2.6038
16/16 [==============================] - 0s 641us/step - loss: 2.5627
16/16 [==============================] - 0s 1ms/step - loss: 2.5085
16/16 [==============================] - 0s 1ms/step - loss: 2.4635
16/16 [==============================] - 0s 1ms/step - loss: 2.4301
16/16 [==============================] - 0s 1ms/step - loss: 2.4196
16/16 [==============================] - 0s 1ms/step - loss: 2.4155

Testing for epoch 49 index 2:
16/16 [==============================] - 0s 633us/step - loss: 0.1446
16/16 [==============================] - 0s 650us/step - loss: 2.0868
16/16 [==============================] - 0s 634us/step - loss: 2.5135
16/16 [==============================] - 0s 605us/step - loss: 2.5636
16/16 [==============================] - 0s 1ms/step - loss: 2.5272
16/16 [==============================] - 0s 640us/step - loss: 2.4769
16/16 [==============================] - 0s 1ms/step - loss: 2.4353
16/16 [==============================] - 0s 608us/step - loss: 2.4045
16/16 [==============================] - 0s 1ms/step - loss: 2.3946
16/16 [==============================] - 0s 1ms/step - loss: 2.3907

Testing for epoch 49 index 3:
16/16 [==============================] - 0s 649us/step - loss: 0.1457
16/16 [==============================] - 0s 624us/step - loss: 2.0862
16/16 [==============================] - 0s 875us/step - loss: 2.5107
16/16 [==============================] - 0s 590us/step - loss: 2.5578
16/16 [==============================] - 0s 573us/step - loss: 2.5165
16/16 [==============================] - 0s 1ms/step - loss: 2.4632
16/16 [==============================] - 0s 1ms/step - loss: 2.4191
16/16 [==============================] - 0s 1ms/step - loss: 2.3864
16/16 [==============================] - 0s 1ms/step - loss: 2.3760
16/16 [==============================] - 0s 611us/step - loss: 2.3718

Testing for epoch 49 index 4:
16/16 [==============================] - 0s 664us/step - loss: 0.1438
16/16 [==============================] - 0s 610us/step - loss: 2.0347
16/16 [==============================] - 0s 601us/step - loss: 2.4431
16/16 [==============================] - 0s 1ms/step - loss: 2.4871
16/16 [==============================] - 0s 636us/step - loss: 2.4479
16/16 [==============================] - 0s 606us/step - loss: 2.3982
16/16 [==============================] - 0s 618us/step - loss: 2.3571
16/16 [==============================] - 0s 639us/step - loss: 2.3267
16/16 [==============================] - 0s 657us/step - loss: 2.3170
16/16 [==============================] - 0s 629us/step - loss: 2.3131

Testing for epoch 49 index 5:
16/16 [==============================] - 0s 641us/step - loss: 0.1474
16/16 [==============================] - 0s 988us/step - loss: 2.0366
16/16 [==============================] - 0s 1ms/step - loss: 2.4480
16/16 [==============================] - 0s 903us/step - loss: 2.4936
16/16 [==============================] - 0s 1ms/step - loss: 2.4559
16/16 [==============================] - 0s 1ms/step - loss: 2.4066
16/16 [==============================] - 0s 635us/step - loss: 2.3658
16/16 [==============================] - 0s 1ms/step - loss: 2.3355
16/16 [==============================] - 0s 797us/step - loss: 2.3259
16/16 [==============================] - 0s 735us/step - loss: 2.3222
Epoch 50 of 60

Testing for epoch 50 index 1:
16/16 [==============================] - 0s 696us/step - loss: 0.1436
16/16 [==============================] - 0s 905us/step - loss: 2.1021
16/16 [==============================] - 0s 841us/step - loss: 2.5288
16/16 [==============================] - 0s 1ms/step - loss: 2.5741
16/16 [==============================] - 0s 623us/step - loss: 2.5332
16/16 [==============================] - 0s 637us/step - loss: 2.4820
16/16 [==============================] - 0s 644us/step - loss: 2.4395
16/16 [==============================] - 0s 949us/step - loss: 2.4076
16/16 [==============================] - 0s 640us/step - loss: 2.3974
16/16 [==============================] - 0s 1ms/step - loss: 2.3933

Testing for epoch 50 index 2:
16/16 [==============================] - 0s 745us/step - loss: 0.1413
16/16 [==============================] - 0s 1ms/step - loss: 2.0536
16/16 [==============================] - 0s 1ms/step - loss: 2.4615
16/16 [==============================] - 0s 1ms/step - loss: 2.4976
16/16 [==============================] - 0s 1ms/step - loss: 2.4550
16/16 [==============================] - 0s 1ms/step - loss: 2.4020
16/16 [==============================] - 0s 1ms/step - loss: 2.3590
16/16 [==============================] - 0s 1ms/step - loss: 2.3276
16/16 [==============================] - 0s 1ms/step - loss: 2.3176
16/16 [==============================] - 0s 1ms/step - loss: 2.3137

Testing for epoch 50 index 3:
16/16 [==============================] - 0s 624us/step - loss: 0.1436
16/16 [==============================] - 0s 1ms/step - loss: 2.0689
16/16 [==============================] - 0s 1ms/step - loss: 2.4842
16/16 [==============================] - 0s 1ms/step - loss: 2.5212
16/16 [==============================] - 0s 1ms/step - loss: 2.4800
16/16 [==============================] - 0s 613us/step - loss: 2.4299
16/16 [==============================] - 0s 614us/step - loss: 2.3885
16/16 [==============================] - 0s 622us/step - loss: 2.3575
16/16 [==============================] - 0s 1ms/step - loss: 2.3477
16/16 [==============================] - 0s 1ms/step - loss: 2.3438

Testing for epoch 50 index 4:
16/16 [==============================] - 0s 636us/step - loss: 0.1412
16/16 [==============================] - 0s 622us/step - loss: 2.0655
16/16 [==============================] - 0s 584us/step - loss: 2.4782
16/16 [==============================] - 0s 999us/step - loss: 2.5137
16/16 [==============================] - 0s 648us/step - loss: 2.4722
16/16 [==============================] - 0s 843us/step - loss: 2.4209
16/16 [==============================] - 0s 889us/step - loss: 2.3791
16/16 [==============================] - 0s 1ms/step - loss: 2.3482
16/16 [==============================] - 0s 1ms/step - loss: 2.3383
16/16 [==============================] - 0s 1ms/step - loss: 2.3344

Testing for epoch 50 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1411
16/16 [==============================] - 0s 608us/step - loss: 2.0600
16/16 [==============================] - 0s 591us/step - loss: 2.4682
16/16 [==============================] - 0s 1ms/step - loss: 2.5009
16/16 [==============================] - 0s 885us/step - loss: 2.4578
16/16 [==============================] - 0s 1ms/step - loss: 2.4045
16/16 [==============================] - 0s 918us/step - loss: 2.3612
16/16 [==============================] - 0s 1ms/step - loss: 2.3293
16/16 [==============================] - 0s 1ms/step - loss: 2.3193
16/16 [==============================] - 0s 648us/step - loss: 2.3153
Epoch 51 of 60

Testing for epoch 51 index 1:
16/16 [==============================] - 0s 658us/step - loss: 0.1459
16/16 [==============================] - 0s 1ms/step - loss: 2.0524
16/16 [==============================] - 0s 593us/step - loss: 2.4624
16/16 [==============================] - 0s 1ms/step - loss: 2.4994
16/16 [==============================] - 0s 1ms/step - loss: 2.4614
16/16 [==============================] - 0s 647us/step - loss: 2.4144
16/16 [==============================] - 0s 956us/step - loss: 2.3751
16/16 [==============================] - 0s 619us/step - loss: 2.3456
16/16 [==============================] - 0s 1ms/step - loss: 2.3363
16/16 [==============================] - 0s 1ms/step - loss: 2.3326

Testing for epoch 51 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1414
16/16 [==============================] - 0s 691us/step - loss: 2.1374
16/16 [==============================] - 0s 586us/step - loss: 2.5654
16/16 [==============================] - 0s 1ms/step - loss: 2.5987
16/16 [==============================] - 0s 601us/step - loss: 2.5514
16/16 [==============================] - 0s 615us/step - loss: 2.4948
16/16 [==============================] - 0s 952us/step - loss: 2.4484
16/16 [==============================] - 0s 996us/step - loss: 2.4143
16/16 [==============================] - 0s 1ms/step - loss: 2.4035
16/16 [==============================] - 0s 1ms/step - loss: 2.3993

Testing for epoch 51 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1408
16/16 [==============================] - 0s 1ms/step - loss: 2.1433
16/16 [==============================] - 0s 1ms/step - loss: 2.5741
16/16 [==============================] - 0s 1ms/step - loss: 2.6115
16/16 [==============================] - 0s 684us/step - loss: 2.5677
16/16 [==============================] - 0s 566us/step - loss: 2.5132
16/16 [==============================] - 0s 617us/step - loss: 2.4685
16/16 [==============================] - 0s 1ms/step - loss: 2.4356
16/16 [==============================] - 0s 1ms/step - loss: 2.4250
16/16 [==============================] - 0s 977us/step - loss: 2.4208

Testing for epoch 51 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1386
16/16 [==============================] - 0s 626us/step - loss: 2.2159
16/16 [==============================] - 0s 607us/step - loss: 2.6627
16/16 [==============================] - 0s 1ms/step - loss: 2.7016
16/16 [==============================] - 0s 616us/step - loss: 2.6579
16/16 [==============================] - 0s 624us/step - loss: 2.6043
16/16 [==============================] - 0s 593us/step - loss: 2.5597
16/16 [==============================] - 0s 1ms/step - loss: 2.5264
16/16 [==============================] - 0s 596us/step - loss: 2.5158
16/16 [==============================] - 0s 1ms/step - loss: 2.5116

Testing for epoch 51 index 5:
16/16 [==============================] - 0s 988us/step - loss: 0.1406
16/16 [==============================] - 0s 819us/step - loss: 2.1877
16/16 [==============================] - 0s 1ms/step - loss: 2.6298
16/16 [==============================] - 0s 1ms/step - loss: 2.6666
16/16 [==============================] - 0s 1ms/step - loss: 2.6212
16/16 [==============================] - 0s 611us/step - loss: 2.5652
16/16 [==============================] - 0s 1ms/step - loss: 2.5194
16/16 [==============================] - 0s 1ms/step - loss: 2.4854
16/16 [==============================] - 0s 787us/step - loss: 2.4747
16/16 [==============================] - 0s 1ms/step - loss: 2.4704
Epoch 52 of 60

Testing for epoch 52 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1391
16/16 [==============================] - 0s 1ms/step - loss: 2.1726
16/16 [==============================] - 0s 1ms/step - loss: 2.6126
16/16 [==============================] - 0s 1ms/step - loss: 2.6499
16/16 [==============================] - 0s 622us/step - loss: 2.6046
16/16 [==============================] - 0s 1ms/step - loss: 2.5491
16/16 [==============================] - 0s 602us/step - loss: 2.5038
16/16 [==============================] - 0s 1ms/step - loss: 2.4703
16/16 [==============================] - 0s 1ms/step - loss: 2.4596
16/16 [==============================] - 0s 625us/step - loss: 2.4553

Testing for epoch 52 index 2:
16/16 [==============================] - 0s 722us/step - loss: 0.1402
16/16 [==============================] - 0s 1ms/step - loss: 2.1077
16/16 [==============================] - 0s 1ms/step - loss: 2.5214
16/16 [==============================] - 0s 1ms/step - loss: 2.5507
16/16 [==============================] - 0s 1ms/step - loss: 2.5038
16/16 [==============================] - 0s 638us/step - loss: 2.4486
16/16 [==============================] - 0s 1ms/step - loss: 2.4039
16/16 [==============================] - 0s 1ms/step - loss: 2.3711
16/16 [==============================] - 0s 1ms/step - loss: 2.3608
16/16 [==============================] - 0s 806us/step - loss: 2.3567

Testing for epoch 52 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1413
16/16 [==============================] - 0s 1ms/step - loss: 2.0789
16/16 [==============================] - 0s 635us/step - loss: 2.4879
16/16 [==============================] - 0s 827us/step - loss: 2.5226
16/16 [==============================] - 0s 1ms/step - loss: 2.4818
16/16 [==============================] - 0s 1ms/step - loss: 2.4316
16/16 [==============================] - 0s 1ms/step - loss: 2.3905
16/16 [==============================] - 0s 1ms/step - loss: 2.3598
16/16 [==============================] - 0s 702us/step - loss: 2.3501
16/16 [==============================] - 0s 672us/step - loss: 2.3462

Testing for epoch 52 index 4:
16/16 [==============================] - 0s 645us/step - loss: 0.1397
16/16 [==============================] - 0s 615us/step - loss: 2.2173
16/16 [==============================] - 0s 828us/step - loss: 2.6506
16/16 [==============================] - 0s 1ms/step - loss: 2.6828
16/16 [==============================] - 0s 1ms/step - loss: 2.6351
16/16 [==============================] - 0s 1ms/step - loss: 2.5777
16/16 [==============================] - 0s 603us/step - loss: 2.5312
16/16 [==============================] - 0s 586us/step - loss: 2.4972
16/16 [==============================] - 0s 874us/step - loss: 2.4864
16/16 [==============================] - 0s 806us/step - loss: 2.4822

Testing for epoch 52 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1400
16/16 [==============================] - 0s 1ms/step - loss: 2.1024
16/16 [==============================] - 0s 1ms/step - loss: 2.5108
16/16 [==============================] - 0s 1ms/step - loss: 2.5405
16/16 [==============================] - 0s 656us/step - loss: 2.4959
16/16 [==============================] - 0s 1ms/step - loss: 2.4414
16/16 [==============================] - 0s 1ms/step - loss: 2.3972
16/16 [==============================] - 0s 928us/step - loss: 2.3648
16/16 [==============================] - 0s 1ms/step - loss: 2.3547
16/16 [==============================] - 0s 1ms/step - loss: 2.3508
Epoch 53 of 60

Testing for epoch 53 index 1:
16/16 [==============================] - 0s 638us/step - loss: 0.1365
16/16 [==============================] - 0s 618us/step - loss: 2.0904
16/16 [==============================] - 0s 1ms/step - loss: 2.4896
16/16 [==============================] - 0s 894us/step - loss: 2.5170
16/16 [==============================] - 0s 1ms/step - loss: 2.4731
16/16 [==============================] - 0s 995us/step - loss: 2.4215
16/16 [==============================] - 0s 1ms/step - loss: 2.3790
16/16 [==============================] - 0s 625us/step - loss: 2.3476
16/16 [==============================] - 0s 634us/step - loss: 2.3377
16/16 [==============================] - 0s 645us/step - loss: 2.3337

Testing for epoch 53 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1351
16/16 [==============================] - 0s 1ms/step - loss: 2.1565
16/16 [==============================] - 0s 618us/step - loss: 2.5687
16/16 [==============================] - 0s 762us/step - loss: 2.5966
16/16 [==============================] - 0s 1ms/step - loss: 2.5494
16/16 [==============================] - 0s 1ms/step - loss: 2.4930
16/16 [==============================] - 0s 648us/step - loss: 2.4471
16/16 [==============================] - 0s 608us/step - loss: 2.4134
16/16 [==============================] - 0s 959us/step - loss: 2.4028
16/16 [==============================] - 0s 1ms/step - loss: 2.3986

Testing for epoch 53 index 3:
16/16 [==============================] - 0s 809us/step - loss: 0.1389
16/16 [==============================] - 0s 1ms/step - loss: 2.1419
16/16 [==============================] - 0s 1ms/step - loss: 2.5512
16/16 [==============================] - 0s 677us/step - loss: 2.5797
16/16 [==============================] - 0s 668us/step - loss: 2.5344
16/16 [==============================] - 0s 671us/step - loss: 2.4806
16/16 [==============================] - 0s 657us/step - loss: 2.4371
16/16 [==============================] - 0s 1ms/step - loss: 2.4050
16/16 [==============================] - 0s 652us/step - loss: 2.3948
16/16 [==============================] - 0s 1ms/step - loss: 2.3908

Testing for epoch 53 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1349
16/16 [==============================] - 0s 1ms/step - loss: 2.1901
16/16 [==============================] - 0s 716us/step - loss: 2.6044
16/16 [==============================] - 0s 1ms/step - loss: 2.6295
16/16 [==============================] - 0s 1ms/step - loss: 2.5800
16/16 [==============================] - 0s 632us/step - loss: 2.5219
16/16 [==============================] - 0s 1ms/step - loss: 2.4752
16/16 [==============================] - 0s 1ms/step - loss: 2.4411
16/16 [==============================] - 0s 1ms/step - loss: 2.4303
16/16 [==============================] - 0s 608us/step - loss: 2.4260

Testing for epoch 53 index 5:
16/16 [==============================] - 0s 626us/step - loss: 0.1361
16/16 [==============================] - 0s 1ms/step - loss: 2.1862
16/16 [==============================] - 0s 634us/step - loss: 2.6026
16/16 [==============================] - 0s 1ms/step - loss: 2.6289
16/16 [==============================] - 0s 602us/step - loss: 2.5794
16/16 [==============================] - 0s 608us/step - loss: 2.5210
16/16 [==============================] - 0s 945us/step - loss: 2.4747
16/16 [==============================] - 0s 1ms/step - loss: 2.4412
16/16 [==============================] - 0s 1ms/step - loss: 2.4307
16/16 [==============================] - 0s 1ms/step - loss: 2.4265
Epoch 54 of 60

Testing for epoch 54 index 1:
16/16 [==============================] - 0s 591us/step - loss: 0.1354
16/16 [==============================] - 0s 716us/step - loss: 2.1140
16/16 [==============================] - 0s 645us/step - loss: 2.5078
16/16 [==============================] - 0s 1ms/step - loss: 2.5307
16/16 [==============================] - 0s 576us/step - loss: 2.4835
16/16 [==============================] - 0s 1ms/step - loss: 2.4278
16/16 [==============================] - 0s 1ms/step - loss: 2.3835
16/16 [==============================] - 0s 721us/step - loss: 2.3512
16/16 [==============================] - 0s 683us/step - loss: 2.3411
16/16 [==============================] - 0s 973us/step - loss: 2.3371

Testing for epoch 54 index 2:
16/16 [==============================] - 0s 746us/step - loss: 0.1375
16/16 [==============================] - 0s 1ms/step - loss: 2.1227
16/16 [==============================] - 0s 1ms/step - loss: 2.5193
16/16 [==============================] - 0s 1ms/step - loss: 2.5434
16/16 [==============================] - 0s 1ms/step - loss: 2.4969
16/16 [==============================] - 0s 928us/step - loss: 2.4432
16/16 [==============================] - 0s 851us/step - loss: 2.4006
16/16 [==============================] - 0s 661us/step - loss: 2.3696
16/16 [==============================] - 0s 980us/step - loss: 2.3598
16/16 [==============================] - 0s 1ms/step - loss: 2.3560

Testing for epoch 54 index 3:
16/16 [==============================] - 0s 939us/step - loss: 0.1385
16/16 [==============================] - 0s 1ms/step - loss: 2.1281
16/16 [==============================] - 0s 629us/step - loss: 2.5285
16/16 [==============================] - 0s 1ms/step - loss: 2.5562
16/16 [==============================] - 0s 598us/step - loss: 2.5119
16/16 [==============================] - 0s 633us/step - loss: 2.4583
16/16 [==============================] - 0s 638us/step - loss: 2.4151
16/16 [==============================] - 0s 639us/step - loss: 2.3836
16/16 [==============================] - 0s 900us/step - loss: 2.3737
16/16 [==============================] - 0s 1ms/step - loss: 2.3698

Testing for epoch 54 index 4:
16/16 [==============================] - 0s 650us/step - loss: 0.1350
16/16 [==============================] - 0s 636us/step - loss: 2.1239
16/16 [==============================] - 0s 1ms/step - loss: 2.5171
16/16 [==============================] - 0s 853us/step - loss: 2.5400
16/16 [==============================] - 0s 596us/step - loss: 2.4914
16/16 [==============================] - 0s 619us/step - loss: 2.4353
16/16 [==============================] - 0s 1ms/step - loss: 2.3913
16/16 [==============================] - 0s 1ms/step - loss: 2.3594
16/16 [==============================] - 0s 1ms/step - loss: 2.3494
16/16 [==============================] - 0s 665us/step - loss: 2.3455

Testing for epoch 54 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1328
16/16 [==============================] - 0s 1ms/step - loss: 2.1880
16/16 [==============================] - 0s 1ms/step - loss: 2.5967
16/16 [==============================] - 0s 619us/step - loss: 2.6189
16/16 [==============================] - 0s 603us/step - loss: 2.5676
16/16 [==============================] - 0s 1ms/step - loss: 2.5074
16/16 [==============================] - 0s 1ms/step - loss: 2.4597
16/16 [==============================] - 0s 1ms/step - loss: 2.4251
16/16 [==============================] - 0s 1ms/step - loss: 2.4143
16/16 [==============================] - 0s 1ms/step - loss: 2.4100
Epoch 55 of 60

Testing for epoch 55 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1320
16/16 [==============================] - 0s 624us/step - loss: 2.2799
16/16 [==============================] - 0s 824us/step - loss: 2.7184
16/16 [==============================] - 0s 644us/step - loss: 2.7484
16/16 [==============================] - 0s 655us/step - loss: 2.6979
16/16 [==============================] - 0s 690us/step - loss: 2.6378
16/16 [==============================] - 0s 1ms/step - loss: 2.5895
16/16 [==============================] - 0s 637us/step - loss: 2.5547
16/16 [==============================] - 0s 806us/step - loss: 2.5438
16/16 [==============================] - 0s 757us/step - loss: 2.5395

Testing for epoch 55 index 2:
16/16 [==============================] - 0s 1ms/step - loss: 0.1319
16/16 [==============================] - 0s 1ms/step - loss: 2.2685
16/16 [==============================] - 0s 1ms/step - loss: 2.6951
16/16 [==============================] - 0s 1ms/step - loss: 2.7210
16/16 [==============================] - 0s 1ms/step - loss: 2.6693
16/16 [==============================] - 0s 905us/step - loss: 2.6086
16/16 [==============================] - 0s 985us/step - loss: 2.5598
16/16 [==============================] - 0s 897us/step - loss: 2.5247
16/16 [==============================] - 0s 1ms/step - loss: 2.5138
16/16 [==============================] - 0s 726us/step - loss: 2.5094

Testing for epoch 55 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1306
16/16 [==============================] - 0s 628us/step - loss: 2.1294
16/16 [==============================] - 0s 571us/step - loss: 2.5162
16/16 [==============================] - 0s 651us/step - loss: 2.5364
16/16 [==============================] - 0s 657us/step - loss: 2.4872
16/16 [==============================] - 0s 620us/step - loss: 2.4317
16/16 [==============================] - 0s 627us/step - loss: 2.3874
16/16 [==============================] - 0s 631us/step - loss: 2.3554
16/16 [==============================] - 0s 911us/step - loss: 2.3455
16/16 [==============================] - 0s 1ms/step - loss: 2.3416

Testing for epoch 55 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1298
16/16 [==============================] - 0s 633us/step - loss: 2.2952
16/16 [==============================] - 0s 1ms/step - loss: 2.7216
16/16 [==============================] - 0s 1ms/step - loss: 2.7446
16/16 [==============================] - 0s 1ms/step - loss: 2.6897
16/16 [==============================] - 0s 611us/step - loss: 2.6254
16/16 [==============================] - 0s 1ms/step - loss: 2.5745
16/16 [==============================] - 0s 1ms/step - loss: 2.5375
16/16 [==============================] - 0s 1ms/step - loss: 2.5260
16/16 [==============================] - 0s 935us/step - loss: 2.5215

Testing for epoch 55 index 5:
16/16 [==============================] - 0s 604us/step - loss: 0.1304
16/16 [==============================] - 0s 1ms/step - loss: 2.1990
16/16 [==============================] - 0s 598us/step - loss: 2.6016
16/16 [==============================] - 0s 1ms/step - loss: 2.6241
16/16 [==============================] - 0s 1ms/step - loss: 2.5736
16/16 [==============================] - 0s 753us/step - loss: 2.5147
16/16 [==============================] - 0s 1ms/step - loss: 2.4677
16/16 [==============================] - 0s 626us/step - loss: 2.4338
16/16 [==============================] - 0s 718us/step - loss: 2.4233
16/16 [==============================] - 0s 852us/step - loss: 2.4191
Epoch 56 of 60

Testing for epoch 56 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1279
16/16 [==============================] - 0s 629us/step - loss: 2.1722
16/16 [==============================] - 0s 1ms/step - loss: 2.5696
16/16 [==============================] - 0s 1ms/step - loss: 2.5888
16/16 [==============================] - 0s 687us/step - loss: 2.5353
16/16 [==============================] - 0s 644us/step - loss: 2.4735
16/16 [==============================] - 0s 1ms/step - loss: 2.4255
16/16 [==============================] - 0s 1ms/step - loss: 2.3910
16/16 [==============================] - 0s 1ms/step - loss: 2.3803
16/16 [==============================] - 0s 1ms/step - loss: 2.3761

Testing for epoch 56 index 2:
16/16 [==============================] - 0s 725us/step - loss: 0.1313
16/16 [==============================] - 0s 1ms/step - loss: 2.1862
16/16 [==============================] - 0s 644us/step - loss: 2.5858
16/16 [==============================] - 0s 1ms/step - loss: 2.6081
16/16 [==============================] - 0s 1ms/step - loss: 2.5577
16/16 [==============================] - 0s 1ms/step - loss: 2.4986
16/16 [==============================] - 0s 1ms/step - loss: 2.4523
16/16 [==============================] - 0s 1ms/step - loss: 2.4191
16/16 [==============================] - 0s 708us/step - loss: 2.4087
16/16 [==============================] - 0s 632us/step - loss: 2.4046

Testing for epoch 56 index 3:
16/16 [==============================] - 0s 620us/step - loss: 0.1281
16/16 [==============================] - 0s 632us/step - loss: 2.2017
16/16 [==============================] - 0s 607us/step - loss: 2.5988
16/16 [==============================] - 0s 573us/step - loss: 2.6178
16/16 [==============================] - 0s 653us/step - loss: 2.5652
16/16 [==============================] - 0s 1ms/step - loss: 2.5044
16/16 [==============================] - 0s 808us/step - loss: 2.4563
16/16 [==============================] - 0s 648us/step - loss: 2.4216
16/16 [==============================] - 0s 724us/step - loss: 2.4108
16/16 [==============================] - 0s 727us/step - loss: 2.4066

Testing for epoch 56 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1283
16/16 [==============================] - 0s 643us/step - loss: 2.2432
16/16 [==============================] - 0s 1ms/step - loss: 2.6497
16/16 [==============================] - 0s 612us/step - loss: 2.6688
16/16 [==============================] - 0s 1ms/step - loss: 2.6142
16/16 [==============================] - 0s 837us/step - loss: 2.5514
16/16 [==============================] - 0s 836us/step - loss: 2.5023
16/16 [==============================] - 0s 1ms/step - loss: 2.4675
16/16 [==============================] - 0s 641us/step - loss: 2.4567
16/16 [==============================] - 0s 1ms/step - loss: 2.4524

Testing for epoch 56 index 5:
16/16 [==============================] - 0s 876us/step - loss: 0.1307
16/16 [==============================] - 0s 1ms/step - loss: 2.2389
16/16 [==============================] - 0s 1ms/step - loss: 2.6476
16/16 [==============================] - 0s 1ms/step - loss: 2.6694
16/16 [==============================] - 0s 646us/step - loss: 2.6174
16/16 [==============================] - 0s 651us/step - loss: 2.5567
16/16 [==============================] - 0s 630us/step - loss: 2.5086
16/16 [==============================] - 0s 645us/step - loss: 2.4744
16/16 [==============================] - 0s 1ms/step - loss: 2.4637
16/16 [==============================] - 0s 634us/step - loss: 2.4595
Epoch 57 of 60

Testing for epoch 57 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1294
16/16 [==============================] - 0s 1ms/step - loss: 2.2039
16/16 [==============================] - 0s 1ms/step - loss: 2.6016
16/16 [==============================] - 0s 1ms/step - loss: 2.6199
16/16 [==============================] - 0s 618us/step - loss: 2.5666
16/16 [==============================] - 0s 1ms/step - loss: 2.5066
16/16 [==============================] - 0s 1ms/step - loss: 2.4594
16/16 [==============================] - 0s 1ms/step - loss: 2.4255
16/16 [==============================] - 0s 967us/step - loss: 2.4150
16/16 [==============================] - 0s 594us/step - loss: 2.4109

Testing for epoch 57 index 2:
16/16 [==============================] - 0s 638us/step - loss: 0.1284
16/16 [==============================] - 0s 633us/step - loss: 2.2483
16/16 [==============================] - 0s 996us/step - loss: 2.6576
16/16 [==============================] - 0s 1ms/step - loss: 2.6801
16/16 [==============================] - 0s 610us/step - loss: 2.6274
16/16 [==============================] - 0s 1ms/step - loss: 2.5661
16/16 [==============================] - 0s 1ms/step - loss: 2.5171
16/16 [==============================] - 0s 905us/step - loss: 2.4817
16/16 [==============================] - 0s 1ms/step - loss: 2.4707
16/16 [==============================] - 0s 1ms/step - loss: 2.4664

Testing for epoch 57 index 3:
16/16 [==============================] - 0s 629us/step - loss: 0.1308
16/16 [==============================] - 0s 1ms/step - loss: 2.2241
16/16 [==============================] - 0s 776us/step - loss: 2.6243
16/16 [==============================] - 0s 1ms/step - loss: 2.6430
16/16 [==============================] - 0s 1ms/step - loss: 2.5906
16/16 [==============================] - 0s 647us/step - loss: 2.5309
16/16 [==============================] - 0s 632us/step - loss: 2.4834
16/16 [==============================] - 0s 617us/step - loss: 2.4493
16/16 [==============================] - 0s 622us/step - loss: 2.4387
16/16 [==============================] - 0s 619us/step - loss: 2.4346

Testing for epoch 57 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1249
16/16 [==============================] - 0s 1ms/step - loss: 2.2824
16/16 [==============================] - 0s 886us/step - loss: 2.6944
16/16 [==============================] - 0s 1ms/step - loss: 2.7119
16/16 [==============================] - 0s 840us/step - loss: 2.6561
16/16 [==============================] - 0s 1ms/step - loss: 2.5941
16/16 [==============================] - 0s 749us/step - loss: 2.5456
16/16 [==============================] - 0s 633us/step - loss: 2.5112
16/16 [==============================] - 0s 631us/step - loss: 2.5004
16/16 [==============================] - 0s 598us/step - loss: 2.4962

Testing for epoch 57 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1268
16/16 [==============================] - 0s 641us/step - loss: 2.2303
16/16 [==============================] - 0s 987us/step - loss: 2.6315
16/16 [==============================] - 0s 755us/step - loss: 2.6520
16/16 [==============================] - 0s 1ms/step - loss: 2.6023
16/16 [==============================] - 0s 1ms/step - loss: 2.5447
16/16 [==============================] - 0s 1ms/step - loss: 2.4980
16/16 [==============================] - 0s 1ms/step - loss: 2.4644
16/16 [==============================] - 0s 1ms/step - loss: 2.4540
16/16 [==============================] - 0s 1ms/step - loss: 2.4499
Epoch 58 of 60

Testing for epoch 58 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1253
16/16 [==============================] - 0s 1ms/step - loss: 2.2804
16/16 [==============================] - 0s 1ms/step - loss: 2.6909
16/16 [==============================] - 0s 1ms/step - loss: 2.7047
16/16 [==============================] - 0s 1ms/step - loss: 2.6461
16/16 [==============================] - 0s 890us/step - loss: 2.5810
16/16 [==============================] - 0s 1ms/step - loss: 2.5304
16/16 [==============================] - 0s 1ms/step - loss: 2.4944
16/16 [==============================] - 0s 1ms/step - loss: 2.4833
16/16 [==============================] - 0s 1ms/step - loss: 2.4788

Testing for epoch 58 index 2:
16/16 [==============================] - 0s 749us/step - loss: 0.1268
16/16 [==============================] - 0s 1ms/step - loss: 2.2590
16/16 [==============================] - 0s 613us/step - loss: 2.6587
16/16 [==============================] - 0s 617us/step - loss: 2.6734
16/16 [==============================] - 0s 1ms/step - loss: 2.6186
16/16 [==============================] - 0s 1ms/step - loss: 2.5570
16/16 [==============================] - 0s 950us/step - loss: 2.5081
16/16 [==============================] - 0s 1ms/step - loss: 2.4730
16/16 [==============================] - 0s 661us/step - loss: 2.4621
16/16 [==============================] - 0s 623us/step - loss: 2.4579

Testing for epoch 58 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1254
16/16 [==============================] - 0s 854us/step - loss: 2.2600
16/16 [==============================] - 0s 1ms/step - loss: 2.6602
16/16 [==============================] - 0s 655us/step - loss: 2.6753
16/16 [==============================] - 0s 1ms/step - loss: 2.6206
16/16 [==============================] - 0s 1ms/step - loss: 2.5580
16/16 [==============================] - 0s 706us/step - loss: 2.5089
16/16 [==============================] - 0s 1ms/step - loss: 2.4739
16/16 [==============================] - 0s 1ms/step - loss: 2.4630
16/16 [==============================] - 0s 1ms/step - loss: 2.4588

Testing for epoch 58 index 4:
16/16 [==============================] - 0s 681us/step - loss: 0.1267
16/16 [==============================] - 0s 775us/step - loss: 2.2358
16/16 [==============================] - 0s 608us/step - loss: 2.6324
16/16 [==============================] - 0s 628us/step - loss: 2.6479
16/16 [==============================] - 0s 610us/step - loss: 2.5940
16/16 [==============================] - 0s 608us/step - loss: 2.5341
16/16 [==============================] - 0s 637us/step - loss: 2.4871
16/16 [==============================] - 0s 611us/step - loss: 2.4534
16/16 [==============================] - 0s 641us/step - loss: 2.4430
16/16 [==============================] - 0s 763us/step - loss: 2.4389

Testing for epoch 58 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1232
16/16 [==============================] - 0s 1ms/step - loss: 2.3007
16/16 [==============================] - 0s 1ms/step - loss: 2.7090
16/16 [==============================] - 0s 631us/step - loss: 2.7214
16/16 [==============================] - 0s 973us/step - loss: 2.6639
16/16 [==============================] - 0s 667us/step - loss: 2.5993
16/16 [==============================] - 0s 1ms/step - loss: 2.5482
16/16 [==============================] - 0s 1ms/step - loss: 2.5115
16/16 [==============================] - 0s 1ms/step - loss: 2.5002
16/16 [==============================] - 0s 1ms/step - loss: 2.4957
Epoch 59 of 60

Testing for epoch 59 index 1:
16/16 [==============================] - 0s 1ms/step - loss: 0.1249
16/16 [==============================] - 0s 703us/step - loss: 2.2634
16/16 [==============================] - 0s 1ms/step - loss: 2.6562
16/16 [==============================] - 0s 1ms/step - loss: 2.6629
16/16 [==============================] - 0s 1ms/step - loss: 2.6041
16/16 [==============================] - 0s 872us/step - loss: 2.5390
16/16 [==============================] - 0s 617us/step - loss: 2.4883
16/16 [==============================] - 0s 687us/step - loss: 2.4527
16/16 [==============================] - 0s 615us/step - loss: 2.4419
16/16 [==============================] - 0s 783us/step - loss: 2.4376

Testing for epoch 59 index 2:
16/16 [==============================] - 0s 700us/step - loss: 0.1249
16/16 [==============================] - 0s 601us/step - loss: 2.2865
16/16 [==============================] - 0s 625us/step - loss: 2.6880
16/16 [==============================] - 0s 581us/step - loss: 2.7004
16/16 [==============================] - 0s 1ms/step - loss: 2.6446
16/16 [==============================] - 0s 714us/step - loss: 2.5815
16/16 [==============================] - 0s 1ms/step - loss: 2.5315
16/16 [==============================] - 0s 1ms/step - loss: 2.4957
16/16 [==============================] - 0s 740us/step - loss: 2.4847
16/16 [==============================] - 0s 1ms/step - loss: 2.4803

Testing for epoch 59 index 3:
16/16 [==============================] - 0s 584us/step - loss: 0.1245
16/16 [==============================] - 0s 787us/step - loss: 2.2729
16/16 [==============================] - 0s 1ms/step - loss: 2.6637
16/16 [==============================] - 0s 1ms/step - loss: 2.6712
16/16 [==============================] - 0s 608us/step - loss: 2.6147
16/16 [==============================] - 0s 654us/step - loss: 2.5526
16/16 [==============================] - 0s 1ms/step - loss: 2.5033
16/16 [==============================] - 0s 891us/step - loss: 2.4684
16/16 [==============================] - 0s 697us/step - loss: 2.4576
16/16 [==============================] - 0s 639us/step - loss: 2.4534

Testing for epoch 59 index 4:
16/16 [==============================] - 0s 637us/step - loss: 0.1250
16/16 [==============================] - 0s 941us/step - loss: 2.2686
16/16 [==============================] - 0s 599us/step - loss: 2.6612
16/16 [==============================] - 0s 1ms/step - loss: 2.6698
16/16 [==============================] - 0s 778us/step - loss: 2.6129
16/16 [==============================] - 0s 691us/step - loss: 2.5509
16/16 [==============================] - 0s 1ms/step - loss: 2.5026
16/16 [==============================] - 0s 623us/step - loss: 2.4683
16/16 [==============================] - 0s 885us/step - loss: 2.4578
16/16 [==============================] - 0s 701us/step - loss: 2.4537

Testing for epoch 59 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1234
16/16 [==============================] - 0s 1ms/step - loss: 2.3238
16/16 [==============================] - 0s 803us/step - loss: 2.7242
16/16 [==============================] - 0s 601us/step - loss: 2.7327
16/16 [==============================] - 0s 647us/step - loss: 2.6743
16/16 [==============================] - 0s 970us/step - loss: 2.6098
16/16 [==============================] - 0s 926us/step - loss: 2.5591
16/16 [==============================] - 0s 1ms/step - loss: 2.5229
16/16 [==============================] - 0s 1ms/step - loss: 2.5118
16/16 [==============================] - 0s 678us/step - loss: 2.5074
Epoch 60 of 60

Testing for epoch 60 index 1:
16/16 [==============================] - 0s 642us/step - loss: 0.1248
16/16 [==============================] - 0s 597us/step - loss: 2.2835
16/16 [==============================] - 0s 629us/step - loss: 2.6774
16/16 [==============================] - 0s 1ms/step - loss: 2.6863
16/16 [==============================] - 0s 644us/step - loss: 2.6273
16/16 [==============================] - 0s 1ms/step - loss: 2.5622
16/16 [==============================] - 0s 956us/step - loss: 2.5114
16/16 [==============================] - 0s 664us/step - loss: 2.4755
16/16 [==============================] - 0s 875us/step - loss: 2.4643
16/16 [==============================] - 0s 593us/step - loss: 2.4600

Testing for epoch 60 index 2:
16/16 [==============================] - 0s 716us/step - loss: 0.1237
16/16 [==============================] - 0s 626us/step - loss: 2.2727
16/16 [==============================] - 0s 1ms/step - loss: 2.6608
16/16 [==============================] - 0s 1ms/step - loss: 2.6688
16/16 [==============================] - 0s 1ms/step - loss: 2.6110
16/16 [==============================] - 0s 919us/step - loss: 2.5473
16/16 [==============================] - 0s 1ms/step - loss: 2.4975
16/16 [==============================] - 0s 780us/step - loss: 2.4622
16/16 [==============================] - 0s 716us/step - loss: 2.4513
16/16 [==============================] - 0s 638us/step - loss: 2.4470

Testing for epoch 60 index 3:
16/16 [==============================] - 0s 1ms/step - loss: 0.1213
16/16 [==============================] - 0s 616us/step - loss: 2.3241
16/16 [==============================] - 0s 618us/step - loss: 2.7152
16/16 [==============================] - 0s 1ms/step - loss: 2.7211
16/16 [==============================] - 0s 1ms/step - loss: 2.6613
16/16 [==============================] - 0s 631us/step - loss: 2.5967
16/16 [==============================] - 0s 741us/step - loss: 2.5461
16/16 [==============================] - 0s 633us/step - loss: 2.5105
16/16 [==============================] - 0s 2ms/step - loss: 2.4996
16/16 [==============================] - 0s 599us/step - loss: 2.4952

Testing for epoch 60 index 4:
16/16 [==============================] - 0s 1ms/step - loss: 0.1217
16/16 [==============================] - 0s 1ms/step - loss: 2.3310
16/16 [==============================] - 0s 1ms/step - loss: 2.7333
16/16 [==============================] - 0s 1ms/step - loss: 2.7466
16/16 [==============================] - 0s 1ms/step - loss: 2.6903
16/16 [==============================] - 0s 833us/step - loss: 2.6273
16/16 [==============================] - 0s 608us/step - loss: 2.5776
16/16 [==============================] - 0s 1ms/step - loss: 2.5424
16/16 [==============================] - 0s 626us/step - loss: 2.5314
16/16 [==============================] - 0s 709us/step - loss: 2.5270

Testing for epoch 60 index 5:
16/16 [==============================] - 0s 1ms/step - loss: 0.1211
16/16 [==============================] - 0s 1ms/step - loss: 2.2989
16/16 [==============================] - 0s 1ms/step - loss: 2.6855
16/16 [==============================] - 0s 1ms/step - loss: 2.6923
16/16 [==============================] - 0s 1ms/step - loss: 2.6322
16/16 [==============================] - 0s 650us/step - loss: 2.5665
16/16 [==============================] - 0s 1ms/step - loss: 2.5155
16/16 [==============================] - 0s 1ms/step - loss: 2.4800
16/16 [==============================] - 0s 844us/step - loss: 2.4690
16/16 [==============================] - 0s 593us/step - loss: 2.4647

outlier_MO_GAAL_one = list(clf.labels_)

outlier_MO_GAAL_one = list(map(lambda x: 1 if x==0  else -1,outlier_MO_GAAL_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_MO_GAAL_one,tab_bunny)

_conf.conf("MO-GAAL (Liu et al., 2019)")

Accuracy: 0.952
Precision: 0.952
Recall: 1.000
F1 Score: 0.975

thirteen = twelve.append(_conf.tab)

LSCP

detectors = [KNN(), LOF(), OCSVM()]
clf = LSCP(detectors)
clf.fit(_df[['x', 'y','fnoise']])
_df['LSCP_clf'] = clf.labels_

/home/csy/anaconda3/envs/csy/lib/python3.8/site-packages/pyod/models/lscp.py:382: UserWarning: The number of histogram bins is greater than the number of classifiers, reducing n_bins to n_clf.
  warnings.warn(

outlier_LSCP_one = list(clf.labels_)

outlier_LSCP_one = list(map(lambda x: 1 if x==0  else -1,outlier_LSCP_one))

_conf = Conf_matrx(outlier_true_one_2,outlier_LSCP_one,tab_bunny)

_conf.conf("LSCP (Zhao et al., 2019)")

Accuracy: 0.940
Precision: 0.996
Recall: 0.941
F1 Score: 0.967

fourteen_bunny = thirteen.append(_conf.tab)

Bunny Result

round(fourteen_bunny,4)

	Accuracy	Precision	Recall	F1
GODE	0.9948	0.9954	0.9992	0.9973
LOF (Breunig et al., 2000)	0.9285	0.9569	0.9685	0.9627
kNN (Ramaswamy et al., 2000)	0.9405	0.9960	0.9413	0.9679
CBLOF (He et al., 2003)	0.9776	0.9895	0.9870	0.9882
OCSVM (Sch ̈olkopf et al., 2001)	0.9321	0.9911	0.9371	0.9633
MCD (Hardin and Rocke, 2004)	0.9349	0.9929	0.9383	0.9648
Feature Bagging (Lazarevic and Kumar, 2005)	0.9149	0.9818	0.9278	0.9540
ABOD (Kriegel et al., 2008)	0.9768	0.9891	0.9866	0.9878
Isolation Forest (Liu et al., 2008)	0.7942	0.9947	0.7881	0.8794
HBOS (Goldstein and Dengel, 2012)	0.8953	0.9695	0.9190	0.9436
SOS (Janssens et al., 2012)	0.8953	0.9695	0.9190	0.9436
SO-GAAL (Liu et al., 2019)	0.9521	0.9521	1.0000	0.9754
MO-GAAL (Liu et al., 2019)	0.9521	0.9521	1.0000	0.9754
LSCP (Zhao et al., 2019)	0.9397	0.9956	0.9408	0.9674