Warning: file_get_contents(/data/phpspider/zhask/data//catemap/8/sorting/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Python 逻辑回归评估的SKL日志丢失引发错误_Python_Machine Learning_Scikit Learn_Logistic Regression_Loss Function - Fatal编程技术网

Python 逻辑回归评估的SKL日志丢失引发错误

Python 逻辑回归评估的SKL日志丢失引发错误,python,machine-learning,scikit-learn,logistic-regression,loss-function,Python,Machine Learning,Scikit Learn,Logistic Regression,Loss Function,我用逻辑回归训练了一个模型,需要用对数损失来评估其准确性。 以下是有关数据的一些详细信息: 功能/X Principal terms age Gender weekend Bachelor HighSchoolerBelow college 0 1000 30 45 0 0 0 1 0 1 1000 30 33 1 0 1

我用逻辑回归训练了一个模型,需要用对数损失来评估其准确性。 以下是有关数据的一些详细信息:

功能/X

   Principal terms age Gender weekend Bachelor  HighSchoolerBelow college
0   1000     30    45   0       0       0               1              0
1   1000     30    33   1       0       1               0              0
2   1000     15    27   0       0       0               0              1
标签/Y

array(['PAIDOFF', 'PAIDOFF', 'PAIDOFF', 'PAIDOFF', 'COLLECTION'], dtype=object)
逻辑回归模型:

from sklearn.linear_model import LogisticRegression
logreg = LogisticRegression(C=1e5, solver='lbfgs', multi_class='multinomial')
Feature = df[['Principal','terms','age','Gender','weekend']]
Feature = pd.concat([Feature,pd.get_dummies(df['education'])], axis=1)
Feature.drop(['Master or Above'], axis = 1,inplace=True)

X = Feature

X= preprocessing.StandardScaler().fit(X).transform(X)

y = df['loan_status'].values

X_train, X_test, y_train, lg_y_test = train_test_split(X, y, test_size=0.3, random_state=4)


# we create an instance of Neighbours Classifier and fit the data.
logreg.fit(X_train, y_train)

lg_loan_status = logreg.predict(X_test)
lg_loan_status
现在我需要计算一下Jaccard、F1得分和LogLoss

以下是我的单独测试数据集:

test_df['due_date'] = pd.to_datetime(test_df['due_date'])
test_df['effective_date'] = pd.to_datetime(test_df['effective_date'])
test_df['dayofweek'] = test_df['effective_date'].dt.dayofweek
test_df['weekend'] = test_df['dayofweek'].apply(lambda x: 1 if (x>3)  else 0)
test_df.groupby(['Gender'])['loan_status'].value_counts(normalize=True)
# test_df['Gender'].replace(to_replace=['male','female'], value=[0,1],inplace=True)
Feature = test_df[['Principal','terms','age','Gender','weekend']]
Feature = pd.concat([Feature,pd.get_dummies(df['education'])], axis=1)
Feature.drop(['Master or Above'], axis = 1,inplace=True)
Feature.head()

X = Feature
Y = test_df['loan_status'].values

Feature.head()
    Principal terms age Gender weekend Bechalor HighSchoolorBelow  college
0   1000.0    30.0  50.0 female  0.0    0               1            0
1   300.0      7.0  35.0  male   1.0    1               0            0
2   1000.0    30.0  43.0 female  1.0    0               0            1
以下是我尝试过的:

# Evaluation for Logistic Regression
X_train, X_test, y_train, lg_y_test = train_test_split(X, y, test_size=0.3, random_state=3)

lg_jaccard = jaccard_similarity_score(lg_y_test, lg_loan_status, normalize=False)
lg_f1_score = f1_score(lg_y_test, lg_loan_status, average='micro')


lg_log_loss = log_loss(lg_y_test, lg_loan_status)

print('Jaccard is : {}'.format(lg_jaccard))
print('F1-score is : {}'.format(lg_f1_score))
print('Log Loss is : {}'.format(lg_log_loss))
但它返回以下错误:

ValueError:无法将字符串转换为浮点:“集合”

更新: 下面是lg_y_测试:

['PAIDOFF' 'PAIDOFF' 'COLLECTION' 'COLLECTION' 'PAIDOFF' 'COLLECTION'
'PAIDOFF' 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF'
 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'COLLECTION'
 'PAIDOFF' 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF'
 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'COLLECTION' 'PAIDOFF'
 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'COLLECTION' 'PAIDOFF' 'COLLECTION'
 'COLLECTION' 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'COLLECTION' 'PAIDOFF'
 'PAIDOFF' 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'COLLECTION' 'COLLECTION'
 'PAIDOFF' 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'COLLECTION' 'COLLECTION'
 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF'
 'COLLECTION' 'COLLECTION' 'PAIDOFF' 'COLLECTION' 'PAIDOFF' 'PAIDOFF'
 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF'
 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF'
 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF'
 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'COLLECTION'
 'COLLECTION' 'PAIDOFF' 'PAIDOFF' 'PAIDOFF' 'COLLECTION' 'PAIDOFF'
 'PAIDOFF' 'PAIDOFF' 'COLLECTION']

问题如下:

要计算对数损失,你需要有预测的概率。 如果仅提供预测类(概率最大的类) 无法计算此指标

只要可能,Sklearn提供了一种预测概率的方法。您应该按如下方式使用它:

lg_loan_status_probas = logreg.predict_proba(X_test)
lg_log_loss = log_loss(lg_y_test, lg_loan_status_probas)

要计算逻辑回归的对数损失或交叉熵损失,请执行以下操作(自包含示例):

参考资料:


Hi@GabrielM,现在它返回另一个错误作为
ValueError:输入包含NaN、无穷大或一个对数据类型来说太大的值('float64')。
你能打印'lg_loan_status_probas'和'lg_y_test'吗?错误出现在
lg_loan_status_probas
,无法打印。我在上面的问题中添加了
lg_y_测试的
print
结果,请看一下!我懂了。请打印“lg贷款状况”好吗?谢谢
from sklearn.datasets import load_iris
from sklearn.linear_model import LogisticRegression
from sklearn import metrics

X, y = load_iris(return_X_y=True)
clf = LogisticRegression(random_state=0).fit(X, y)
clf.predict(X[:2, :])

clf.predict_proba(X[:2, :])


clf.score(X, y)

y_probs = cls.predict_proba(X)
qry_loss_t = metrics.log_loss(y, y_probs)