Running a System Test

Last modified 16:39, 2 Nov 2012

System Test Process

The first step in running a system test is to select a Trading System upon which the test will be run.

Click the System Builder command in the Systems tool bar menu to open the Select Trading System dialog box, it contains all previously saved Trading Systems.

From this dialog box you can do the following

  • Select an existing Trading System and run a System Test using it
  • Select  an existing Trading System, alter it and then run a System Test using it, or
  • Create a New Trading System and then run a System Test using it.

In either case, once the Trading System is defined in the System Criteria tabbed page in the form that you are satisfied with, click the Start button to run the Trading System test.

Note - System Tests employ off-line scans. In order for these to function, a local database must be established and maintained for the types of data and markets that the test will be run against. See the Data Requirements section, below.

Start and Run a Systems Test

System Tests are commenced by selecting the Start button from the System Testing work page's function bar:

Any of the four tabbed pages can be open when the test is started.

Warning Message if Results Exist

When a System Test is re-run, the data in its Results table will be overwritten.

A warning message advising you of this will appear:

syststresultwarning.png

Select Yes to overwrite the existing results table.

This Warning can be avoided by selecting Clear Trade Results from the Action menu before starting the test.

Save Results before Re-running the Test

You can also select No and then save the results using the Action menu's Export Trade Results command:

The data will be exported in a comma separated value (.csv) format file.

After exporting you can then run the new test without fear of losing the previous test's results.

Data Requirements

The scans used in System Tests are off-line Market scans using price and/or fundamental data.

In order for the scan to be valid, a complete historical database for the Market, Symbol Group (i.e. Quote List or Scan Results) or Individual Symbols must be downloaded and maintained on the local PC.

Depending on the time-frame set for the System Test, the data may need to be updated to bring the database completely up-to-date, or custom data-downloads may be required.

The maintenance of price data and fundamental data follow different procedures, refer to the discussion in the Data Types help topic for an overview of these differences.

The following data issues should be considered depending on the scope of the System Test:

Full Market Scans

For System Tests using price data and/or fundamental data scans extending over whole markets, data must be locally maintained for the whole market for the entire period covered by the time-frame of the System Test.

The only practicable way to maintain this quantity of data is to subscribe to HUBB Financial's Daily Data Pack Service.

These services require an initial database to be created on the local PC, and then those databases can be maintained via daily Data Pack downloads.

For more information on these processes, go to the Daily Datapacks topic and the Full Market down-loads topic.

Quote List

The price data for all of the symbols on a Quote List can be downloaded and maintained using the Advanced Data on Demand command in the Quote List's Action menu.

For more information on this service, go to the Advanced Data on Demand topic in the Quote Pages section of this help.

If scans using fundamental data are used in the System Test, the fundamental data for the symbols on the Quote List will have to be maintained using the Fundamental Data Daily Datapacks.

Scan Results

The Scan Results should be based on valid data from the first scan that produced the results.

The best way to maintain the data used in the scan depends on the scope of the scan (i.e. whole market, or quote list, etc.)  and its time-frame.

Individual Symbols

Price data for individual symbols can be downloaded using the Custom Data-on-Demand function. For more information, go to the Custom Data-on-Demand topic.

Fundamental Data for individual symbols can be downloaded using a similar facility. From a Single Stock Analysis page use the Fundamental Data Custom Data-on-Demand function. Go to the Fundamental Data Download topic for more information.

Running the System Test

After pressing Start, and Yes if results currently exist, the Trade Listing tabbed page will open, if it is not already open:

The scanning indicator will open and remain open for the duration of the scan.

Test Controls in Function Bar

The test can be controlled using the Pause, Start [re-start] and Stop buttons in the System Test function bar.

Start

When the System Test is started, the Start button will become disabled.

Pause

Click Pause to temporarily pause the System Test.

When Pause is selected, the Start button will become enabled again.

Click Start to restart the test. Click Stop to terminate the test.

Stop

Click Stop to terminate the System Test.

Process Indicators

While the System Test is running, a number of process indicators display information about the progress of the test.

Status Bar while Running Test

While the test is running the status bar at the bottom of the System Test work page will display details of the progress of the test results.

Progress Indicator

As the test progresses, the approximate progress of the test is indicated in the Progress Indicator.

The blue line will gradually fill in the box as the test progresses.

Trading Date

The test will process all symbols in the market or group one day at a time, beginning with the Start Date.

The date that is currently being processed will appear in this text box.

Symbol

As the symbols in the market or group are being processed they will appear in this text box.

Account Balance

This is the starting balance less costs and any realized losses, and including currently owned assets (i.e. trades entered into but not yet exited from).

This balance is updated dynamically as the test is run.

Running Balance

This is the starting balance less all realized losses and outgoings, but with realized gains added back in.

This balance is updated dynamically as the test is run.

Profit/Loss

Net realized (i.e. trade entered and exited) profits are shown in green, net realized losses are shown in red.

This amount is updated dynamically as the test is run.

Status Bar when Test completed

While the test is completed the status bar at the bottom of the System Test work page will display details of the test results.

Progress Indicator

When the test is complete the entire Progress Indicator will be filled with the blue line.

Last Date Tested

The date of the latest data tested will be displayed.

Normally this date is the date nominated as the End Date in the system criteria settings, unless that date was a non-trading day.

Symbol

The last symbol tested will appear in this text box.

Account Balance

The final Account Balance is displayed, this is comprised of less costs and any realized losses, and including currently owned assets (i.e. trades entered into but not yet exited from).

Running Balance

The final Running Balance is displayed, this is comprised of all realized losses and outgoings, but with realized gains added back in.

Profit/Loss

Net profits are shown in green, net realized losses are shown in red.

Results

As soon as the Start button begins to run the system test, the Trade Listing tabbed page of the system test work page will display, and results will be added to it as they are generated.

For more information go to the System Test Results topic.

Page statistics
627 view(s) and 6 edit(s)
Social share
Share this page?

Tags

This page has no classifications.

Comments

You must to post a comment.

Attachments