Jenkins 量角器-jasmine2-html-reporter不';t使用';共享测试时,整合所有测试的结果;shardTestFiles';:在conf文件中为true
最近,我们将e2e测试配置为在Jenkins上进行&很快我们就意识到我们必须使用共享测试文件:真正的选项,因为完整的套件运行需要很长的时间,我们每天都要看9-10个小时。但当我们在conf文件中配置以下两个选项时。测试运行正常,但最终报告仅在保存路径中显示上次规格运行结果。合并所有选项不会提供完整的报告 请查找我们的conf文件详细信息。任何帮助都将不胜感激 根据Aditya提供的解决方案编辑conf文件。请帮忙Jenkins 量角器-jasmine2-html-reporter不';t使用';共享测试时,整合所有测试的结果;shardTestFiles';:在conf文件中为true,jenkins,jasmine,protractor,gulp-protractor,jasmine-reporters,Jenkins,Jasmine,Protractor,Gulp Protractor,Jasmine Reporters,最近,我们将e2e测试配置为在Jenkins上进行&很快我们就意识到我们必须使用共享测试文件:真正的选项,因为完整的套件运行需要很长的时间,我们每天都要看9-10个小时。但当我们在conf文件中配置以下两个选项时。测试运行正常,但最终报告仅在保存路径中显示上次规格运行结果。合并所有选项不会提供完整的报告 请查找我们的conf文件详细信息。任何帮助都将不胜感激 根据Aditya提供的解决方案编辑conf文件。请帮忙 var Jasmine2HtmlReporter = require('pr
var Jasmine2HtmlReporter = require('protractor-jasmine2-html-reporter');
var log4js = require('log4js');
var params = process.argv;
var args = process.argv.slice(3);
exports.config = {
//seleniumServerJar: './node_modules/gulp-protractor/node_modules/protractor/selenium/selenium-server-standalone-2.48.2.jar',
seleniumAddress: 'http://localhost:4444/wd/hub',
allScriptsTimeout: 100000,
framework: 'jasmine2',
onPrepare: function () {
return new Promise(function(fulfill, reject) {
browser.getCapabilities().then(function(value) {
reportName = value.get(Math.random(8,2)) + '_' + value.get('browserName') + '_' + Math.floor(Math.random() * 1E16);
jasmine.getEnv().addReporter(
new Jasmine2HtmlReporter({
//cleanDestination: false,
savePath: __dirname+'/target',
//docTitle: 'Web UI Test Report',
screenshotsFolder: 'image',
//takeScreenshots: true,
takeScreenshotsOnlyOnFailures: true,
consolidate: true,
consolidateAll: true,
preserveDirectory: true,
//fixedScreenshotName: true,
filePrefix: reportName + ".html"
})
);
fulfill();
});
});
// browser.manage().timeouts().implicitlyWait(11000);
var width = 768;
var height = 1366;
browser.driver.manage().window().setSize(768, 1366);
browser.ignoreSynchronization = false;
},
afterLaunch: function afterLaunch() {
var fs = require('fs');
var output = '';
fs.readdirSync('target/').forEach(function (file) {
if (!(fs.lstatSync('target/' + file).isDirectory()))
output = output + fs.readFileSync('target/' + file);
});
fs.writeFileSync('target/ConsolidatedReport.html', output, 'utf8');
},
suites:{
example:['./test/e2e/specs/**/*Spec.js',]
},
/* capabilities: {
'browserName': 'chrome'
},*/
multiCapabilities: [
{
'browserName': 'chrome'
},
{
'browserName': 'firefox'
}
],
resultJsonOutputFile:'./results.json',
// Options to be passed to Jasmine-node.
jasmineNodeOpts: {
showColors: true,
defaultTimeoutInterval: 100000
}
};
我目前正在努力解决同样的问题,但是在我的原型设置中,它正在工作,我正在使用基本配置,仅此而已
var Jasmine2HtmlReporter = require('protractor-jasmine2-html-reporter');
exports.config = {
framework: 'jasmine',
seleniumAddress: 'http://localhost:4444/wd/hub',
specs: ['**-spec**.js'],
capabilities: {
browserName: 'chrome',
shardTestFiles: true,
maxInstances: 2
},
onPrepare: function() {
jasmine.getEnv().addReporter(
new Jasmine2HtmlReporter({
savePath: 'target/',
screenshotsFolder: 'images',
consolidate: true,
consolidateAll: false // false in my saved config - true in tut.
})
);
}
}
你能看看你能不能让碎片报告工作在最低限度吗
编辑:还要注意目标文件夹中发生的事情,Jasmine可能会在您不需要时覆盖/清理它
编辑2:如果您选择我下面的解决方案,请确保您启动了足够多的浏览器,因为您有规格-如果您拆分规格,我下面的解决方案将根据浏览器ID生成报告:
capabilities: {
browserName: 'chrome',
shardTestFiles: true,
maxInstances: **2**
},
如果您想要超过2个,它将仍然覆盖您的reporter HTML。它根据用于测试它的浏览器/会话ID创建一个HTML文件-如果使用2个浏览器实例,您将获得2个HTML文件,不多不少
编辑3:一个快速解决办法是不要让茉莉花清理干净
cleanDestination: false,
但这似乎没有什么作用,所以在搜索和搜索之后——我不认为jasmine html reporter会让我们整合比碎片更多的规范。github上的问题跟踪程序未显示任何进展
所以我能想到的唯一解决方案是使用我下面的解决方案,有足够的碎片来支持你的大量规格,然后在你完成后将其解析回一个文件
编辑4:您总是可以滥用Jenkins在实际测试运行之间关联HTML文件。限制在于“Jasmine2HtmlReporter”,因为它在测试并行运行时会覆盖HTML报告文件。但避免这种情况绝对是可能的,有几种方法可以做到这一点。根据您的方便选择正确的方式 1) 修补Jasmine2HtmlReporter的'index.js'以附加文件,而不是使用PhantomJs覆盖文件 2) 通过从onPrepare()函数配置Jasmine2HTML reporter生成唯一的HTML报告,并在以后合并所有报告 解决方案1:Jasmine2HtmlReporter-
index.js
的当前代码库使用两个函数--phantomWrite()
&nodeWrite()
来写入数据。提及
我创建了一个新函数-appendwrite()
以进行追加而不是覆盖,并修改了代码以提取此函数
查看我的github代码,它是从
并修改“node_modules/dragrator-jasmine2-html-reporter/index.js”中的self.writeFile
函数以获取新函数
try {
appendwrite(path, filename, text);
//phantomWrite(path, filename, text);
return;
} catch (e) { errors.push(' PhantomJs attempt: ' + e.message); }
try {
nodeWrite(path, filename, text);
return;
} catch (f) { errors.push(' NodeJS attempt: ' + f.message); }
并注释以下在新运行时清理报告的代码,以便您不会看到任何错误清理错误-
解决方案2:通过在OnPrepare函数中配置Jasmine reporter,基于sessionID为并行实例生成单独的报告
onPrepare: function() {
return new Promise(function (fulfill, reject) {
browser.getCapabilities().then(function (value) {
reportName = value.get('webdriver.remote.sessionid') + '_' + value.get('browserName') + '_' + Math.floor(Math.random()*1E16);
jasmine.getEnv().addReporter(
new Jasmine2HtmlReporter({
savePath: 'target/',
screenshotsFolder: 'images',
consolidate: true,
consolidateAll: true,
filePrefix: reportName + ".html"
})
);
fulfill();
})
});
},
步骤2:完成测试并关闭所有webdriver会话后,在afterLaunch()方法中合并跨并行实例生成的报告
afterLaunch: function afterLaunch() {
var fs = require('fs');
var output = '';
fs.readdirSync('target/').forEach(function(file){
if(!(fs.lstatSync('target/' + file).isDirectory()))
output = output + fs.readFileSync('target/' + file);
});
fs.writeFileSync('target/ConsolidatedReport.html', output, 'utf8');
},
您将看到下面生成的报告,其中还包含一个合并的报告
请忽略任何打字错误和语法错误。这只是一个示例,可以定制
EDIT1:我们用来命名HTML报告的“sessionID”是webdriver远程sessionID,如果您怀疑它在多个会话中可能不唯一,只需为各个HTML报告生成一个随机数,然后合并即可
我已经修改了上面的代码来自Aditya的解决方案对我来说很好。 我的示例配置文件: var Jasmine2HtmlReporter=require('dragrator-jasmine2-html-reporter') exports.config={ 框架:“jasmine2”, 硒酸钠, /多容量:[ { 'browserName':'chrome', “shardTestFiles”:true, “maxInstances”:2, 色度选项:{ 参数:['chrome.switches','--禁用扩展'] } }, { 'browserName':'firefox' } ],/ 能力: { 'browserName':'chrome', “shardTestFiles”:true, “maxInstances”:2, 色度选项:{ 参数:['chrome.switches','--禁用扩展'] } }, 套房:{ loginpage:'login.js', addproduct:'addproduct.js' }, //规格:['addproduct.js'], 茉莉花:{ onComplete:null, isVerbose:false, includeStackTrace:正确, showColors:对, defaultTimeoutInterval:30000 },
}我使用下面的解决方案创建具有唯一时间戳的唯一文件夹。这将把HTML报告保存在日期时间戳文件夹中,而不是Jasmin-2-HTML-reporter删除它
var today = new Date();
var timeStamp = today.getMonth() + 1 + '-' + today.getDate() + '-' + today.getFullYear() + '-' +
today.getHours() + 'h-' + today.getMinutes() + 'm-' +today.getSeconds()+'s';
jasmine.getEnv().addReporter(
new Jasmine2HtmlReporter({
savePath: './Reports/testResultsReport '+timeStamp,
screenshotsFolder: 'screenPrints',
takeScreenshots: true,
takeScreenshotsOnlyOnFailures: true,
})
);
`这里是另一个解决方案,它建立在这个基础之上,使用
dragrator-html-reporter-2
,它可以处理由jasmine reporters
生成的xml文件。但是,jasmine reporters
没有任何选项来处理由多个浏览器实例生成的报告。在未能找到理想的解决方案后,我最终在量角器配置js文件中执行了以下操作:
// add relevant packages in package.json
'use strict';
const HTMLReport = require('protractor-html-reporter-2');
const jasmineReporters = require('jasmine-reporters');
const moment = require('moment');
const os = require('os');
const xmldoc = require('xmldoc');
...
const DATE_FORMAT = 'YYYYMMDD-HHmmss-SSS'; // use any other format that gives unique timestamp
const reportDir = path.join(__dirname, '../report');
...
exports.config = {
...
framework: 'jasmine',
capabilities: {
browserName: 'chrome',
maxInstances: 2,
shardTestFiles: true,
},
beforeLaunch: async function () {
// clean up report directory
fs.emptyDirSync(reportDir);
},
onPrepare: async function () {
const NOW = moment().format(DATE_FORMAT);
const reportName = 'index-' + NOW;
jasmine.getEnv().addReporter(new jasmineReporters.JUnitXmlReporter({
consolidateAll: true,
savePath: reportDir,
filePrefix: reportName,
}));
},
onComplete: async function () {
// do something after each instance of browser is closed
},
afterLaunch: async function (exitCode) {
// do something after ALL instances of browser are closed
await consolidateJasmineXmlReports();
},
...
},
...
async function consolidateJasmineXmlReports() {
// there may be better ways to write xml out but this works for me
const files = fs.readdirSync(reportDir).filter(fn => fn.endsWith('.xml'));
let disabledSum = 0;
let errorsSum = 0;
let failuresSum = 0;
let testsSum = 0;
let timeSum = 0;
const allTestSuiteNodes = [];
for (const file of files) {
const pathToXml = reportDir + path.sep + file;
console.log('Reading xml report file: ' + pathToXml);
const xml = fs.readFileSync(pathToXml);
const xmlDoc = new xmldoc.XmlDocument(xml);
const disabled = parseInt(xmlDoc.attr.disabled);
const errors = parseInt(xmlDoc.attr.errors);
const failures = parseInt(xmlDoc.attr.failures);
const tests = parseInt(xmlDoc.attr.tests);
const time = parseFloat(xmlDoc.attr.time);
disabledSum += disabled;
errorsSum += errors;
failuresSum += failures;
testsSum += tests;
timeSum += time;
const testSuiteNodes = xmlDoc.childrenNamed('testsuite');
allTestSuiteNodes.push(testSuiteNodes);
}
let startXml = `<?xml version="1.0" encoding="UTF-8" ?>`;
startXml += `<testsuites disabled="` + disabledSum + `" errors="` + errorsSum + `" failures="` + failuresSum + `" tests="` + testsSum + `" time="` + timeSum + `">`;
const endXml = '</testsuites>';
allTestSuiteNodes.push(endXml);
const finalXml = startXml + allTestSuiteNodes.join('\n');
fs.writeFileSync(reportDir + path.sep + 'consolidated.xml', finalXml, 'utf8');
const testConfig = {
outputPath: reportDir,
outputFilename: 'consolidated',
...
};
new HTMLReport().from(reportDir + path.sep + 'consolidated.xml', testConfig);
}
//在package.json中添加相关包
"严格使用",;
常量HTMLReport=require('dragrator-html-reporter-2');
const jasmineReporters=require('jasmine-reporters');
恒力矩=要求的(‘力矩’);
const os=要求('os');
常量xmldoc=require('x
onPrepare: function() {
return new Promise(function(fulfill, reject) {
browser.getCapabilities().then(function(value) {
reportName = value.get(Math.random(8,2)) + '_' + value.get('browserName') + '_' + Math.floor(Math.random() * 1E16);
jasmine.getEnv().addReporter(
new Jasmine2HtmlReporter({
//cleanDestination: false,
savePath: 'target/',
//docTitle: 'Web UI Test Report',
screenshotsFolder: 'image',
//takeScreenshots: true,
//takeScreenshotsOnlyOnFailures: true,
consolidate: true,
consolidateAll: true,
// preserveDirectory: true,
//fixedScreenshotName: true,
filePrefix: reportName + ".html"
})
);
fulfill();
});
});
},
afterLaunch: function afterLaunch() {
var fs = require('fs');
var output = '';
fs.readdirSync('target/').forEach(function(file) {
if (!(fs.lstatSync('target/' + file).isDirectory()))
output = output + fs.readFileSync('target/' + file);
});
fs.writeFileSync('target/ConsolidatedReport.html', output, 'utf8');
}
var today = new Date();
var timeStamp = today.getMonth() + 1 + '-' + today.getDate() + '-' + today.getFullYear() + '-' +
today.getHours() + 'h-' + today.getMinutes() + 'm-' +today.getSeconds()+'s';
jasmine.getEnv().addReporter(
new Jasmine2HtmlReporter({
savePath: './Reports/testResultsReport '+timeStamp,
screenshotsFolder: 'screenPrints',
takeScreenshots: true,
takeScreenshotsOnlyOnFailures: true,
})
);
// add relevant packages in package.json
'use strict';
const HTMLReport = require('protractor-html-reporter-2');
const jasmineReporters = require('jasmine-reporters');
const moment = require('moment');
const os = require('os');
const xmldoc = require('xmldoc');
...
const DATE_FORMAT = 'YYYYMMDD-HHmmss-SSS'; // use any other format that gives unique timestamp
const reportDir = path.join(__dirname, '../report');
...
exports.config = {
...
framework: 'jasmine',
capabilities: {
browserName: 'chrome',
maxInstances: 2,
shardTestFiles: true,
},
beforeLaunch: async function () {
// clean up report directory
fs.emptyDirSync(reportDir);
},
onPrepare: async function () {
const NOW = moment().format(DATE_FORMAT);
const reportName = 'index-' + NOW;
jasmine.getEnv().addReporter(new jasmineReporters.JUnitXmlReporter({
consolidateAll: true,
savePath: reportDir,
filePrefix: reportName,
}));
},
onComplete: async function () {
// do something after each instance of browser is closed
},
afterLaunch: async function (exitCode) {
// do something after ALL instances of browser are closed
await consolidateJasmineXmlReports();
},
...
},
...
async function consolidateJasmineXmlReports() {
// there may be better ways to write xml out but this works for me
const files = fs.readdirSync(reportDir).filter(fn => fn.endsWith('.xml'));
let disabledSum = 0;
let errorsSum = 0;
let failuresSum = 0;
let testsSum = 0;
let timeSum = 0;
const allTestSuiteNodes = [];
for (const file of files) {
const pathToXml = reportDir + path.sep + file;
console.log('Reading xml report file: ' + pathToXml);
const xml = fs.readFileSync(pathToXml);
const xmlDoc = new xmldoc.XmlDocument(xml);
const disabled = parseInt(xmlDoc.attr.disabled);
const errors = parseInt(xmlDoc.attr.errors);
const failures = parseInt(xmlDoc.attr.failures);
const tests = parseInt(xmlDoc.attr.tests);
const time = parseFloat(xmlDoc.attr.time);
disabledSum += disabled;
errorsSum += errors;
failuresSum += failures;
testsSum += tests;
timeSum += time;
const testSuiteNodes = xmlDoc.childrenNamed('testsuite');
allTestSuiteNodes.push(testSuiteNodes);
}
let startXml = `<?xml version="1.0" encoding="UTF-8" ?>`;
startXml += `<testsuites disabled="` + disabledSum + `" errors="` + errorsSum + `" failures="` + failuresSum + `" tests="` + testsSum + `" time="` + timeSum + `">`;
const endXml = '</testsuites>';
allTestSuiteNodes.push(endXml);
const finalXml = startXml + allTestSuiteNodes.join('\n');
fs.writeFileSync(reportDir + path.sep + 'consolidated.xml', finalXml, 'utf8');
const testConfig = {
outputPath: reportDir,
outputFilename: 'consolidated',
...
};
new HTMLReport().from(reportDir + path.sep + 'consolidated.xml', testConfig);
}