Default unit testing failing on hello world

[benjlin]

When attempting to run unit testing on the default template app it crashes with

bens-mbp:test benjlin$ tns test ios
Searching for devices...
01 05 2018 07:27:07.314:WARN [karma]: No captured browser, open http://localhost:9876/
01 05 2018 07:27:07.328:INFO [karma]: Karma v2.0.2 server started at http://0.0.0.0:9876/
01 05 2018 07:27:07.329:INFO [launcher]: Launching browser ios with unlimited concurrency
01 05 2018 07:27:07.357:INFO [launcher]: Starting browser NativeScript Unit Test Runner
Executing before-prepare hook from /Users/benjlin/Documents/Code/Nativescript/test/hooks/before-prepare/nativescript-dev-typescript.js
Found peer TypeScript 2.6.2
Preparing project...
01 05 2018 07:27:10.721:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/app.component.js".
01 05 2018 07:27:10.722:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/app.module.js".
01 05 2018 07:27:10.723:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/main.aot.js".
01 05 2018 07:27:10.725:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/main.js".
01 05 2018 07:27:10.977:WARN [karma]: No captured browser, open http://localhost:9876/
01 05 2018 07:27:14.197:INFO [Chrome 65.0.3325 (Mac OS X 10.13.4)]: Connected on socket hD-sUKklfXQ2LEbmAAAA with id manual-3472
Project successfully prepared (ios)
Executing after-prepare hook from /Users/benjlin/Documents/Code/Nativescript/test/hooks/after-prepare/nativescript-unit-test-runner.js
Executing before-liveSync hook from /Users/benjlin/Documents/Code/Nativescript/test/hooks/before-liveSync/nativescript-angular-sync.js
Skipping prepare.
Successfully transferred all files.
Refreshing application...
Successfully synced application org.nativescript.test on device AD2FE2D6-4E3F-41B8-AE8C-460BE9C15843.
Executing before-watch hook from /Users/benjlin/Documents/Code/Nativescript/test/hooks/before-watch/nativescript-dev-typescript.js
Found peer TypeScript 2.6.2
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:54:28: NSUTR: fetching http://127.0.0.1:9876/context.json
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:54:28: NSUTR: fetching http://192.168.86.105:9876/context.json
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:54:28: NSUTR: fetching http://169.254.100.211:9876/context.json
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:60:32: NSUTR: found karma at 127.0.0.1
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:97:20: NSUTR: connecting to karma at http://127.0.0.1:9876
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:60:32: NSUTR: found karma at 192.168.86.105
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:60:32: NSUTR: found karma at 169.254.100.211
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:116:24: NSUTR: successfully connected to karma
01 05 2018 07:27:24.238:INFO [NativeScript / 11.3 (11.3; iPhone)]: Connected on socket pi1YRlwENESpccmzAAAB with id NativeScriptUnit-2789
Chrome 65.0.3325 (Mac OS X 10.13.4) ERROR
  {
    "message": "An error was thrown in afterAll\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined",
    "str": "An error was thrown in afterAll\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined"
  }
Chrome 65.0.3325 (Mac OS X 10.13.4): Executed 1 of 1 ERROR (0.01 secs / 0 secs)
01 05 2018 07:27:24.414:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/app.component.js".
01 05 2018 07:27:24.578:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/app.module.js".
01 05 2018 07:27:24.679:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/main.js".
01 05 2018 07:27:24.680:INFO [watcher]: Changed file "/Users/benjlin/Documents/Code/Nativescript/test/app/main.aot.js".
01 05 2018 07:27:24.934:INFO [karma]: Delaying execution, these browsers are not ready: NativeScript / 11.3 (11.3; iPhone)
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:159:20: NSUTR: downloading http://127.0.0.1:9876/context.json
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:200:32: NSUTR: eval script /base/node_modules/jasmine-core/lib/jasmine-core/jasmine.js?daba65c98fa088349a3e9d7df843a63405ccfc15
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:200:32: NSUTR: eval script /base/node_modules/karma-jasmine/lib/boot.js?945a38bf4e45ad2770eb94868231905a04a0bd3e
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:200:32: NSUTR: eval script /base/node_modules/karma-jasmine/lib/adapter.js?3e6cdea3167f037eeb11034f8eb9ce63b21a8105
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:196:32: NSUTR: require script /base/app/tests/example.js?d4cad4cd203df70666c986cd09ce402b21d89b39 from ../../tests/example.js
Chrome 65.0.3325 (Mac OS X 10.13.4): Executed 1 of 1 ERROR (0.01 secs / 0 secs)
Chrome 65.0.3325 (Mac OS X 10.13.4): Executed 1 of 1 ERROR (0.01 secs / 0 secs)
NativeScript / 11.3 (11.3; iPhone): Executed 1 of 1 SUCCESS (0.014 secs / 0 secs)
CONSOLE LOG file:///app/tns_modules/nativescript-unit-test-runner/main-view-model.js:258:24: NSUTR: completeAck
Chrome 65.0.3325 (Mac OS X 10.13.4) ERROR
  {
    "message": "An error was thrown in afterAll\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined",
    "str": "An error was thrown in afterAll\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined\nUncaught ReferenceError: exports is not defined"
  }
Chrome 65.0.3325 (Mac OS X 10.13.4): Executed 1 of 1 ERROR (0.004 secs / 0 secs)
7:27:25 AM - Compilation complete. Watching for file changes.



NativeScript / 11.3 (11.3; iPhone) ERROR
  Disconnected
Chrome 65.0.3325 (Mac OS X 10.13.4): Executed 1 of 1 ERROR (0.004 secs / 0 secs)
^CExecuting after-watch hook from /Users/benjlin/Documents/Code/Nativescript/test/hooks/after-watch/nativescript-dev-typescript.js
Stopping tsc watch

Steps to replicate

1. run tns create HelloWorld --template nativescript-template-ng-tutorial
2. cd ./HelloWorld
3. tns run ios
4. tns test init
5. Select Jasmin as the test framework
6. admire the failed test.

the same error occurs running both android and ios

I suspect that it is something to do with the default Karma configuration file generated

module.exports = function(config) {
  config.set({

    // base path that will be used to resolve all patterns (eg. files, exclude)
    basePath: '',


    // frameworks to use
    // available frameworks: https://npmjs.org/browse/keyword/karma-adapter
    frameworks: ['jasmine'],


    // list of files / patterns to load in the browser
    files: [
      'app/**/*.js',
    ],


    // list of files to exclude
    exclude: [
    ],


    // preprocess matching files before serving them to the browser
    // available preprocessors: https://npmjs.org/browse/keyword/karma-preprocessor
    preprocessors: {
    },


    // test results reporter to use
    // possible values: 'dots', 'progress'
    // available reporters: https://npmjs.org/browse/keyword/karma-reporter
    reporters: ['progress'],


    // web server port
    port: 9876,


    // enable / disable colors in the output (reporters and logs)
    colors: true,


    // level of logging
    // possible values: config.LOG_DISABLE || config.LOG_ERROR || config.LOG_WARN || config.LOG_INFO || config.LOG_DEBUG
    logLevel: config.LOG_INFO,


    // enable / disable watching file and executing tests whenever any file changes
    autoWatch: true,


    // start these browsers
    // available browser launchers: https://npmjs.org/browse/keyword/karma-launcher
    browsers: [],

    customLaunchers: {
      android: {
        base: 'NS',
        platform: 'android'
      },
      ios: {
        base: 'NS',
        platform: 'ios'
      },
      ios_simulator: {
        base: 'NS',
        platform: 'ios',
        arguments: ['--emulator']
      }
    },

    // Continuous Integration mode
    // if true, Karma captures browsers, runs the tests and exits
    singleRun: false
  })
}

[tsonevn]

Hi @benjlin,
Thank you for contacting us.
We will check reported case and will verify if there is a real issue, which could lead to a crash on the application. You can keep track on the issue for further info.

[pekevski]

I also experience this issue within my project and recreated it by following the testing documentation for the downloaded playground application. It seems when invoking the tns test , the client disconnects from the karma server because it cannot compile some javascript.

I get the following errors in the console for the browser:

[CapellaBlue]

@pekevski Did you discover the cause of your "uncaught ReferenceError: exports is not defined"

[slaven3kopic]

Same behavior while running "tns test android" for template app (https://github.com/NativeScript/template-drawer-navigation-ng). Any info about this issue?

[CapellaBlue]

Here's what I learned:

Use an emulator. When you start your app, (for me it became 'npm start') and Karma asked to open a browser,I was doing so...only to get the exports not defined error.

Having an emulator set up within the AVD management portion of Android studio helped. After lots of requests for me to open a browser, karma finally just opens the emulator.

However, I was still unable to run tests. I ran into "Zone is undefined" afterwards...which is likely related to the karma.config file set up, although I'm unsure why just yet.

Most recommendations I've seen advise not to use Karma on mobile apps, which has been in response to a lack of solution being found.

Either way, look at your karma.config file and try using an emulator.

[benjlin]

The initial error that I got was on an emulator, I tried again on the simulator and also found that to be broken, I posted the results from the ios emulator dump and it seems that when my post was edited to read cleaner that was lost.

I will try again in the next few days to see if anything has changed with the 4.1.X release as well as downgrade to 3.4.X to see if it is present there

[benjlin]

I ran a clean install of nativescript on a new computer, and when i downloaded the helloWorld template

tns create HelloWorld --template nativescript-template-ng-tutorial

I found it still broken by default, however after upgrading the typescript dev definition from "~2.7.2" to "2.9.2" i found that the tests work, after successfully running the test, the app crashes but it does successfully run the tests

19 07 2018 13:45:28.905:WARN [karma]: No captured browser, open http://localhost:9876/
Skipping prepare.
Building project...
Gradle build...
+ setting applicationId
+ applying user-defined configuration from /Users/benjlin/Documents/Code/Nativescript/HelloWorld/app/App_Resources/Android/app.gradle
+ adding nativescript runtime package dependency: nativescript-optimized-with-inspector
+ adding aar plugin dependency: /Users/benjlin/Documents/Code/Nativescript/HelloWorld/node_modules/tns-core-modules-widgets/platforms/android/widgets-release.aar
Project successfully built.
Installing...
Successfully installed on device with identifier 'emulator-5554'.
Successfully transferred all files.
Refreshing application...
Successfully synced application org.nativescript.HelloWorld on device emulator-5554.
ActivityManager: Start proc 5906:org.nativescript.HelloWorld/u0a83 for activity org.nativescript.HelloWorld/com.tns.NativeScriptActivity
JS: NSUTR: fetching http://127.0.0.1:9876/context.json
JS: NSUTR: fetching http://192.168.86.187:9876/context.json
JS: NSUTR: found karma at 192.168.86.187
JS: NSUTR: connecting to karma at http://192.168.86.187:9876
JS: NSUTR: successfully connected to karma
19 07 2018 13:45:58.549:INFO [NativeScript / 27 (8.1.0; Android SDK built for x86)]: Connected on socket wg-mJZTlcILAXHEVAAAA with id NativeScriptUnit-81
JS: NSUTR: downloading http://192.168.86.187:9876/context.json
JS: NSUTR: eval script /base/node_modules/jasmine-core/lib/jasmine-core/jasmine.js?daba65c98fa088349a3e9d7df843a63405ccfc15
JS: NSUTR: eval script /base/node_modules/karma-jasmine/lib/boot.js?945a38bf4e45ad2770eb94868231905a04a0bd3e
JS: NSUTR: eval script /base/node_modules/karma-jasmine/lib/adapter.js?6cf71867f538f40db053c1775b2c56a83696375c
JS: NSUTR: require script /base/app/tests/example.js?d4cad4cd203df70666c986cd09ce402b21d89b39 from ../../tests/example.js
JS: NSUTR: beginning test run
NativeScript / 27 (8.1.0; Android SDK built for x86): Executed 0 of 1 SUCCESS (0 secs / 0 secs)
NativeScript / 27 (8.1.0; Android SDK built for x86): Executed 1 of 1 SUCCESS (0.109 secs / 0.004 secs)
TOTAL: 1 SUCCESS
JS: NSUTR: completeAck
NativeScript / 27 (8.1.0; Android SDK built for x86) ERROR
Disconnected
NativeScript / 27 (8.1.0; Android SDK built for x86): Executed 1 of 1 SUCCESS (0.109 secs / 0.004 secs)
ActivityManager: Process org.nativescript.HelloWorld (pid 5906) has died: fore TOP
ActivityManager: setHasOverlayUi called on unknown pid: 5906
^CExecuting after-watch hook from /Users/benjlin/Documents/Code/Nativescript/HelloWorld/hooks/after-watch/nativescript-dev-typescript.js
Stopping tsc watch
Executing after-watch hook from /Users/benjlin/Documents/Code/Nativescript/HelloWorld/hooks/after-watch/nativescript-dev-typescript.js

[slaven3kopic]

@pekevski , @CapellaBlue ,

I had the same problem. I've solved it by doing "tns test init", and picking the mocha framework. Then add the following files to /test folder:

test-config.ts . With content:

(global).mocha.setup({
timeout: 20000
});

import * as chai from 'chai';
export let assert: typeof chai.assert = (global).chai.assert;

test-main.ts . With content:

import 'nativescript-angular/zone-js/testing.mocha';
import {nsTestBedInit} from 'nativescript-angular/testing';
nsTestBedInit();

example.ts . With content:

import {assert} from './test-config';

describe('A suite', function() {
it('contains spec with an expectation', function() {
assert.equal(true, true);
});
});

Result:

JS: NSUTR: eval script /base/node_modules/chai/chai.js?40e7aa72e9665366bfd82579520de4fb0754dfae
JS: NSUTR: eval script /base/node_modules/karma-chai/adapter.js?bab484a2111791847997ed88414622bccfbd2749
JS: NSUTR: eval script /base/node_modules/mocha/mocha.js?8bf1d1adf34e719cca6e8f6915b9cd6eabf83d6b
JS: NSUTR: eval script /base/node_modules/karma-mocha/lib/adapter.js?e8826109cf50b958ee4bd667517729ffdd4de363
JS: NSUTR: require script /base/app/tests/example.js?5f2953ee9642c9402922f1858f6c6daeb474e644 from ../../tests/example.js
JS: NSUTR: require script /base/app/tests/test-config.js?0feba9db7ae5fc2c47ffef99cf2314ec89d56428 from ../../tests/test-config.js
JS: NSUTR: require script /base/app/tests/test-main.js?20993e7c421b970122391ecef7a52ed3b0866208 from ../../tests/test-main.js
JS: NSUTR: beginning test run
NativeScript / 27 (8.1.0; Android SDK built for x86): Executed 0 of 1 SUCCESS (0 secs / 0 secs)
NativeScript / 27 (8.1.0; Android SDK built for x86): Executed 1 of 1 SUCCESS (0.141 secs / 0.002 secs)
TOTAL: 1 SUCCESS

[m-abs]

I ran into this too.
I created a new project with tns create <NAME> --ng and configured testing with tns test init --framework jasmine.

This gave the same error as @benjlin reported.

After a while I tried renaming src to app and updated my tsconfig.json and nsconfig.json to match that and that solved the problem.
I don't understand why it worked, but it did.

[irwansyahwii]

@m-abs I believe it works because the hooks didn't ran when you are using the new structure but when you changed to the old structure then the hooks will ran and the tests will success

[Oatelaus]

I've managed to resolve this (exports is not defined) by degrading jasmine-core to ^2.9.0.

[vakrilov]

Hey folks. I also managed to get the test running by renaming src -> app as @m-abs mentioned.
I had to change src to app in karma.config.js, nsconfig.json and tsconfig.json as well.