Sift Explore Release Notes

Version 1.9.7-1 (24th March 2025)

Improvements and Fixes

  • Project Overview: Fix error adding KPI using 'Add...' button
  • Scripting Sandbox: Fix error importing azure-storage-blob package

Version 1.9.5-0 (28th August 2024)

Improvements and Fixes

  • Flags: Fix exception changing flag from 'Rule Based' to 'Manual'
  • Project Overview: Fix new instances not reflected in some views when added using script
  • Custom KPIs: Allow column resizing in kpi definitions table of managed kpis

Version 1.9.4-0 (6th August 2024)

Improvements and Fixes

  • Flags: Fix issue applying flags that have rules with date ranges

Version 1.9.3-0 (31st July 2024)

Improvements and Fixes

  • Scripting Sandbox: Fix wsgiref submodules not found

Version 1.9.2-1 (30th July 2024)

Improvements and Fixes

  • Binned Data Viewer: Fix exception after deleting binned map
  • Binned Data Mapper: Fixes mapping configuration not saved on first map calculation
  • Binned Data Mapper: Add gap filling availability check before signal synthesis
  • Flags: Fix broadcast error applying flag based on supporting signal
  • Project File: Improve index integrity validation during append operations
  • Project File: Fix duplicated signal storage ids
  • Scatter Viewer: Fix flagged points from scatter view not reflected after clearing filters
  • Scripting Sandbox: Fix wsgiref module not found

Version 1.9.1-1 (28th June 2024)

Improvements and Fixes

  • Fix: Required openpyxl version not available
  • Project Overview: Fix buttons disabled for items when changing selection from parent node to child

Version 1.9.0-68 (14th June 2024)

Features

  • 2LS Importers: New Nispera connector available
  • Binned Data Mapper: Synthesised Data signals can now be created directly from binned map configuration
  • Binned Data Mapper: Added 'Instance Property' grouping option
  • KPIs: New Plugin KPIs
  • KPIs: New Data Coverage KPI
  • Project Overview: New shortcuts added for opening visualization of selected analysis
  • Release Notes: Link to release notes when prompting to upgrade
  • Reports: Allow to export signal and flags to HDF
  • SM Connection: Added package upload overview
  • Scripting Sandbox: Allows plotting of matplotlib figures
  • Signals: Implemented data quality flags

Improvements and Fixes

  • API: Add calculate_signal method to sift api
  • Binned Data: Fix exception reading empty binned map when node exist in file structure
  • Binned Data Mapper: Set default value for existing configurations query
  • Binned Data Mapper: Fix mismatching index lengths error in binned map creation
  • Binned Data Mapper: Rename 'Mapper' tab to 'Create Binned Map'
  • Binned Data Mapper: Rename 'Synthesise Binned Map' to 'Gap Fill Binned Map'
  • Binned Data Mapper: Improve unclear warning message refreshing gap filling configurations
  • Binned Data Viewer: Fix error with span selector on binned map
  • Binned Data Viewer: Fix X option stat selection not working for mean and median
  • Calculated Signals: Fix UI not loading correctly when signal belongs to signal group with duplicated display name
  • Calculated Signals: Script output not updated during/after script execution
  • Data Importers: Fix Project Overview exception after appending GEC data
  • Data Importers: Fix data written to invalid group if non-primary device id changed in GEC importer
  • Data Importers: Fix utm letter excluded during import
  • Data Importers: Fix solar instance data not being imported in Greenbyte importer
  • Data Importers: Fix deleted supporting instance selected by default during append
  • Data Importers: Normalise date range to 10 minutes if interval looks like 10m in SQL Importer
  • Data Importers: Strip whitespaces on signals import in CSV importer
  • Data Importers: Fix database does not exist error connecting to server the first time in Postgres Importer
  • Data Importers: Allow adding extra signals to Nispera connector through config files
  • Data Importers: Improve duplicate events detection by looking at all columns
  • Data Manager: Raise an exception when trying to access signal using an alias if multiple signals are matched for the alias
  • Data Manager: Only set data to nan when the dataframe is non-empty
  • Data Manager: Reduce size of signals data and flags cache
  • Energy Loss Report: Substitute invalid chars in sheet title
  • Event Data: Filter out event with NaT end dates
  • Event Data: Convert value arguments to type in event data column
  • Expressions Parser: Improve FilterSyntaxError messages
  • Flags: Add threshold validation to search flag rules
  • Flags: Ensure overlapping index names applying search flag rules
  • Flags: Fix memory leak
  • Flags: Fix signals order un search rule signal selector
  • Flags: Fix rule filter string validation not updating on enter pressed
  • Flags: Fix warning navigating away from rules editor after rules were applied
  • Flags: Fix plots not updating after rules calculation
  • Flags: Fix newly added signals now showing up in search rule editor
  • Flags: Trigger garbage collection after applying rule
  • Flags: Ensure that search rule flags with a non-default date range are saved correctly
  • Gap Filling: Fix index not matching error
  • Heatmap Viewer: Align origin of heatmap and trace plots x-axes
  • Heatmap Viewer: Allow changing y-axis order
  • Heatmap Viewer: Fixing issue with kpi visualiser loading trace of wrong type
  • Heatmap Viewer: KPI grouped by flag now shows flag name instead of flag value in axis labels
  • KPIs: Ensure KPI for expected production dc adjusted (synthesised) normalised is available in Sift KPI
  • KPis: Fix error moving newly added custom kpi one position up
  • KPIs: Fix exception editing kpi definition filter string
  • KPIs: Fix ufunc casting error during calculation
  • KPIs: Make loss zero if count is zero in Energy loss KPI
  • KPIs: Fix date_range and signals validation in KPI settings validator
  • KPIs: Fix exception re-ordering using arrow
  • KPIs: Fix normalised Sift Chrono Kpis resulting in only nans
  • KPIs: Power data coverage KPI now based on 'power' and 'expected_power' signals
  • KPIs: Allow single group in custom kpis calculation
  • KPIs: Fix 'Year' time period grouping in chronological kpi calculation
  • Memory: Improve memory usage
  • Performance: General performance review
  • Pipelines: Fix reanalysis task corrupting files
  • Pipelines: Fix exception opening pipelines editor
  • Pipelines: Handle exception after renaming flag
  • Pipelines: Improve asynchronous task description in progress bar
  • Pipelines: Ensure reanalysis task cancel checks cancel pipeline execution
  • Pipelines: Add authentication information to reanalysis task
  • Pipelines: Fix logic to resolve date_from in reanalysis task
  • Pipelines: Fix reanalysis executor shutdown after pipeline execution complete
  • Pipelines: Improve waitbar percentage for asynchronous tasks
  • Pipelines: Add missing AppDirs dependency for reanalysis downloader task
  • Pipelines: Fix exception adding calculated signals when calculation result is None or empty
  • Pipelines: Fix flag rules period resolution
  • Pipelines: Set default rounding for Append SQL Data task
  • Pipelines: Fix datetime passing to get_variable scripts
  • Pipelines: Fix run this + downstream nodes running undesired nodes
  • Pipelines: Add apply data quality rules task
  • Pipelines: Fix aware/unware datetime comparison in append reanalysis task
  • Pipelines: Fix exception PipelineScriptInput has no attribute 'available'
  • Pipelines: Improve performance of calculate kpis task validation
  • Pipelines: Add task duration logger
  • Pipelines: Fix filter strings validation in calculate kpis task
  • Pipelines: Add search specs validation to apply flags task
  • Pipelines: Exception trying to run deleted script from RunScripts task
  • Pipelines: Fix cannot use the same name in script input and output at the same time
  • Pipelines: Fix script variables not being resolved when used as task parameter
  • Pipelines: Avoid loading flag data during search flag validation
  • Pipelines: Fix memory leak in calculate signals task
  • Pipelines: Add flag and rule names to exception logging in apply flags task
  • Pipelines: Auto reset zoom on selected pipeline change
  • Pipelines: Prevent pipeline execution failure due to deleted analysis
  • Plots: Fix plots not updating after re-applying flag
  • Plots: Fix data plot not updating when changing turbine
  • Project File: Fix Ran out of input reading tables array
  • Project File: Handle specific repack error
  • Project File: Prevent mismatching index and data arrays sizes in instance data
  • Project File: Fix NaN values set during group index reset
  • Project Overview: Change 'Upload' button to 'Save and Upload' in Sift Monitor Connection view
  • Project Overview: Fix tree view not updating upon new signals and instances import
  • Project Overview: Fix error deleting last signal from a signal group
  • Project Overview: Fix tree view misbehaviour deleting all binned maps
  • Project Overview: Fix exception launching project overview
  • Project Overview: Reorganise and rename KPIs
  • Project Overview: Add data quality properties to signal group summary
  • Project Overview: Fix 'Apply all flags' button disabled when flags node is selected
  • Project Overview: Remove group from supporting signals in tree view
  • Project Overview: Performance improvement loading files with lots of groups and instances
  • Project Overview: Make Sift Monitor managed analysis read only
  • Project Overview: Allow to cancel Binned Map and KPI calculations
  • Properties Importer: Fix unexpected warning and failed signal re-mapping
  • Properties Importer: Fix multi items edit in details views
  • Properties Importer: Fix calculated signal imported to multiple groups
  • Properties Importer: Fix import failing on pipelines
  • Properties Importer: Improve reliability in signal matcher
  • Reanalysis Importer: Fix two days offset in Merra downloaded data
  • Reanalysis Importer: Hide reanalysis passwords in the UI
  • Reanalysis Importer: Improve the ERA download items creation to avoid downloading not requested data
  • Reanalysis Importer: Handle merra connection error updating max available date
  • Reanalysis Importer: Ensure all selected months and days get added
  • Reanalysis Importer: Fix issue with adding too many months to era request
  • Reanalysis Importer: Fix era importer deleting existing data
  • Reanalysis Importer: Project Overview not updating when new data is added
  • Reanalysis Importer: Fix ERA data downloaded as constant signal
  • Reanalysis Importer: Allow to submit new downloads from pipelines when pending downloads exists in project file
  • Reports: Fix signal and flags export with commas in signal ids and alias being ignored
  • Scatter Viewer: Fix error changing flag type
  • Scatter Viewer: Fix scatter plot not showing any data when selecting signals from different groups
  • Scatter Viewer: Fix data selection mismatch due to timezone when foreground date range selector is linked to timeseries
  • Scatter Viewer: Fix error navigating instances with in poly active
  • Scatter Viewer: Fix in poly filtering reapplied on click after deleting filter
  • Scatter Viewer: Add opacity option
  • Scatter Viewer: Fix exception thrown selecting polygon tool
  • Scripting Sandbox: Add new keyword argument to scripting sandbox function get_signal, to allow returning all data
  • Scripting Sandbox: Fix signal property update from script not reflecting everywhere in the UI
  • Scripting Sandbox: Allow using code output as stream handler for logging
  • Scripting Sandbox: Fix report progress not working if 'report_progress' not in script
  • Signals: Allow alias to be the same as signal id
  • Timeseries Viewer: Fix error zooming
  • Timeseries Viewer: Fix exception during plot update after deleting flag
  • Timeseries Viewer: Fix error zomming out chart using scroll
  • Timeseries Viewer: Only re-draw if axes are set correctly
  • Timeseries Viewer: Use ConciseDateFormatter for x-axis
  • Timeseries Viewer: Fix reanalysis data shown as only dots for every zoom level
  • Visualisations: Fix visualisation points not updating on flag category change
  • Visualisations: Fix exceptions plotting empty signals in histogram and timeseries viewer
  • Visualisations: Add new default Sift Explore colormaps
  • Variables: Allow more decimal places for values

Version 1.8.0-97 (27th January 2023)

Features

  • Rotorsoft Importer: Implement rotorsoft integration
  • Sift Monitor: Adding Sift Monitor integration
  • Visualization Modules: New signals navigation interface
  • Bookmarks: Implement automatic session bookmark
  • Histogram: Add statistical testing in difference mode
  • KPI Visualiser: Added sum by quadrature to aggregators
  • Pipelines: Add Import CSV task
  • Pipelines: Allow partial pipeline execution
  • Project: Adding project variables
  • Scatter Plot: Allow mapping a third signal values to color intensities in plot

Improvements and Fixes

  • CSV/SQL Importer: Add timezone selector
  • CSV Importer: Validate Timestamp and Time columns are not the same when time in separate column is set
  • CSV Importer: Handle single timestamp import error
  • CSV Importer: Add unhandled exceptions
  • CSV Importer: Ensure that quote char taken into account for column headings
  • SQL Importer: Normalise date range to 10 minutes if interval looks like 10m
  • SQL Importer: Fixing issue when min_datetime or max_datetime are null from database
  • Bazefield Importer: Do not provide site-id as default
  • Greenbyte Importer: Ensure that already-tzaware times are not converted in GEC importer
  • Import Data: Store UTM zone and ensure zone converting from lat/lon
  • Import Data: Fix issue when supporting ID contains a slash or is changed
  • Import Data: Default date from for append based on previous imports
  • Import Data: Import instance metadata on each import but only write properties if existing data is None
  • Import Data: Skip signals or flags that don't exist when appending index
  • Reanalysis Importer: Improve the ERA download items creation to avoid downloading not requested data
  • Reanalysis Importer: Handle merra connection error updating max available end date
  • Project Overview: Add shortcuts to analysis modules
  • Project Overview: Allow reordering instances
  • Project Overview: Fix shift+click behaviour in instance metadata table
  • Project Overview: Disable selection using right click keep context menu
  • Project Overview: Make signals metadata table editable
  • Project Overview: Allow adding new instances
  • Project Overview: Allow adding signal to selected instance and signal groups
  • Project Overview: Allow to create arbitrary instance properties
  • Project Overview: Make notes section smaller by default and add draggable separator
  • Project Overview: Move Binned Maps and Synthesis into Project Overview
  • Project Overview: Move KPIs into project overview
  • Project Overview: Fix prompt to save pipeline after opening node editor without making any change
  • Project Overview: Move pipelines into ProjectOverview module
  • Project Overview: Make autosave in pipelines and scripts optional
  • Project Overview: Allow to duplicate binned maps
  • Project Overview: Fix scripting sandbox dead zone
  • Project Overview: Improve tree view refeshing
  • Project Overview: Enable duplicate pipeline
  • Project Overview: Allow deleting binned maps
  • Project Overview: Move flag controls functionality to tree view controls
  • Timeseries: Fix error zooming
  • Timeseries: Fix autoscale only uses primary signal
  • Timeseries: Fix issue when single value on timeseries axis
  • Pipelines: Add button to reset zoom and re-center nodes
  • Bookmarks: Allow to recover recently deleted bookmaks/templates
  • Pipelines: Handle exception after renaming flag
  • Pipelines: Improve waitbar percentage for asynchronous tasks
  • Pipelines: Fix flag rules period resolution
  • Pipelines: Set default rounding for Append SQL Data task
  • Pipelines: Skip not rule-based flags in ApplyFlags task
  • Pipelines: Fix error running downstream nodes when terminals are passing trough
  • Pipelines: Allow to pass variables into scripts when running from pipeline
  • Pipelines: Fix issue extracting variables from scripts with heading and trailing spaces in arguments
  • Pipelines: Fix deletion of pipe of pipes
  • Pipelines: Fix dangling terminal value not propagating to scripts
  • Pipelines: Implement secret integration with Sift Monitor
  • Pipelines: Fix instance iterator for supporting groups in calculate signals task
  • Pipelines: Fix issue with timezone on apply flags task
  • Pipelines: Avoid apply flags runtime warnings
  • Pipelines: Fix issue passing parameter from dangling terminal to script variable
  • Pipelines: Fix dangling input in script not propagated according to pass through
  • Pipelines: ensure that flags cleared before running
  • Pipelines: Improve pipeline status reporting
  • Pipelines: Flag rule date range: prefer rule dates
  • Binned Data Viewer: Fix error opening binned 3D view
  • Binned Data Viewer: Keep binned span grid lines after plot update
  • Binned Data Viewer: Add standard error of the mean
  • Binned Data: Create quantiles in binned maps
  • Binned Map Synthesis: Improve binned map index validation errors handling
  • Binned Map Synthesis: Add limit parameter for forward and backward filling methods
  • Binned Map Synthesis: Fixes error 'ValueError: cannot set using a list-like indexer with a different length than the value'
  • Binned Map Synthesis: Fix error synthesising binned map with no levels in index
  • Properties Importer: Fix unexpected warning and failed signal re-mapping
  • Properties Importer: Fix project signals order in dependencies mapping
  • Properties Importer: Fix calculated signal imported to multiple groups
  • Properties Importer: Make details view height adjustable
  • Properties Importer: Fix error exporting newly created binned map
  • Properties Importer: Add order to properties during import
  • Properties Importer: Fix error importing scripts
  • Properties Importer: Fix flags warning for mapped flags importing KPIs
  • Properties Importer: Fix default mapping not showing in analysis local mapping
  • Scripting Sandbox: Allow instance display names in flag mask index
  • Scripting Sandbox: Fix get_variable call excluded from pipeline variables when at the start of the line
  • Scripting Sandbox: Improve get_signal performance when signal_id is a list
  • Scripting Sandbox: Allow user to access utm zone from scripting sandbox
  • Scripting Sandbox: Add get_signal_group_members function
  • Scripting Sandbox: Add set_signal_property to scripting sandbox
  • Scripting Sandbox: Add set_variable function
  • Scripting Sandbox: Expose new Sift API
  • Flag Manager: Add threshold validation to search flag rules
  • Flag Manager: Fix signals order in search rule signal selector
  • Flag Manager: Ensure filter string validation cache is invalidated on flag re-naming
  • Flag Manager: Fix error setting flag rule name
  • Histogram: Add secondary axes in difference mode as needed and make normalised the default count type option
  • KPI Manager: Add minimum sample filter
  • Plugins: Allow plugin data to be written to Sift file
  • Legend: Fix default legend location
  • Sift Updates: Add check for updates now option
  • Analysis Modules: Add link Y axes functionality
  • Analysis Modules: Handle error when no data exist in the project file for selected signal
  • Analysis Modules: fix issue where valid limit of 0.0 is ignored for display
  • Application: Allow enabling debug logging from UI
  • Scatter: Fix signal id resolution if alias is not available
  • Scatter: Fix exception opening linked module whith in_poly filter applied
  • Direction Calibration: Fix error clicking instances. Filter secondary groups instances
  • Direction Calibration: Warn user if rotor diameter invalid value is found
  • Signal Manager: Paste value copied from single cell into multiple cells
  • Signal Manager: Fix key error creating template script
  • Signal Manager: Validate new signal id against existing aliases
  • Signal Manager: Allow alias to match signal id
  • Energy Loss KPI: Substitute invalid chars in sheet title on export
  • Energy Loss KPI: Add weekly option
  • User KPI: Update source value validation when moving kpi definitions and fix exception
  • User KPI: Allow calculation of single KPI
  • User KPI: Add percentiles as KPI statistic options
  • Sift KPI: Adding KPI for expected production dc adjusted (synthesised) normalised
  • KPI Visualiser: Improve performance
  • KPI Visualiser: Clear axes before plot update
  • KPI Visualiser: Fix aggregator scale
  • Project: Enable saving for file without instance data
  • Project: Allow save as when project has not been modified
  • Project: Verify signal integrity and remove signals that do not have data
  • Flag Manager: Add flagged_as options for derated and degraded to filter shortcuts
  • Flag Manager: Ensure that search rule flags with a non-default date range are saved correctly
  • Flag Manager: Improve flag manager performance on flag edit
  • Event Viewer: Fix error duplicating multiple events
  • Event Viewer: Fix issue with sorting nan event data values
  • Reanalysis Importer: ensure all months and days get added
  • Reanalysis Importer: ensure that we don't add an empty date range
  • Reanalysis Importer: download data when checking status
  • Instance Properties: Display UTM zone by default. Handle duplicated property exception
  • Performance: improve loading of binned maps & KPIs
  • Scatter Plot: Improve performance plotting calculated signal vs instance signal
  • Sift API: Add delete_signal method
  • Sift API: Add delete_instance method

Version 1.7.0-70 (26th August 2021)

Features

  • Data Importer: Import from Bazefield
  • Reanalysis Downloader: Interface to download merra & era data
  • Project Overview: Add new Project Overview module
  • Bookmarks/Templates: Allow to save and restore session workspace
  • Properties Importer: Signal match engine

Improvements and Fixes

  • Axis Limits: Improve the way axis limits work
  • Binned Viewer: Add additional data validation to secondary y extent method
  • Binned Viewer: Fix format of secondary axis title
  • Binned viewer: Fix Show/Edit Table disabled in context menu
  • Bug Reporting: Do not hang up sift with a bug report
  • CSV Importer: Add permission error check
  • CSV Importer: Allow csv files to have different column orders
  • CSV Importer: Handle file not found error in directory import
  • CSV Importer: Handle ValueError exception
  • Data Importer: Avoid re-download existing data when device name changes
  • Data Importer: Fix error getting device ids
  • Data Importer: Fix error writing file after appending new event data
  • Data Importer: Fix OutOfBoundsDatetime exception downloading event data
  • Data Importer: Fixing issue when no instance data is imported
  • Data Importer: Make import tasks reversible transactions
  • Data Importer: Replace '/' and ':' in device name during import
  • Data Importer: Sort signals by name
  • Data Importer: Use device id to map remote instance names to existing local instances
  • Data Manager: Fix unalignable boolean series provided as indexer. Ensure all the indexes have the project timezone in get_values_and_flags_multi_instance
  • Data Mapper: Fix exception in setting of Binned map grouped by flag
  • Energy Loss Calc: Fix issue when mask is empty
  • Event Data Viewer: Fix error sorting custom column with inconsistent data types
  • Filters: Add get_events and duration_in_events to filter string processing
  • Filters: Change set unavailable filter logic to flagged_as(unav) & ~flagged_as(ina)
  • Flag Import: Fix issue importing flags from SQL
  • Flag Manager: Add threshold validation to search flag rules
  • Flag Manager: Ensure overlapping index names applying search flag rules
  • Flag Manager: Fix broadcast error applying flag
  • Flag Manager: Fix error importing flags when rule has null instances value
  • Flag Manager: Fix signals order in search rule signal selector
  • Flag Manager: Reset flag when control is disabled in search rule configuration
  • Heatmaps: Change 'Visualisation' label to 'Saved Visualisations'
  • Histogram Viewer: Change difference to use primary - secondary
  • Histogram: Flags are ordered according to flag priority
  • KPI Manager: Add some settings validation to template Kpis
  • KPI Manager: Display progress detail in Basic KPI
  • KPI Manager: Displayed text in unset signal selector
  • KPI Manager: Fix default kpi type when not available in metadata
  • KPI Manager: Fix error evaluating constant expression
  • KPI Manager: Handle duplicated flag names
  • KPI Manager: Remove invalid flags in Energy Loss KPI populate model
  • KPI Manager: Validation for required signals before running a KPI
  • Launcher: Add 'Recovered' label to launcher title when working with recovered files
  • Licensing: Fix issue with checking out multiple licenses
  • Pipelines: Add 'Server Type' input to Append Sql Data nodes
  • Pipelines: Add cancel checks to interrupt pipeline execution before completion when requested
  • Pipelines: Add date editors for append data tasks
  • Pipelines: Add kpi properties even if kpi data is empty
  • Pipelines: Auto populate api token in append gec data nodes. Exclude api token when exporting from pipelines UI
  • Pipelines: Enable add_path in scripts when running from a pipeline
  • Pipelines: Ensure custom datetimes are always resolved as datetime objects
  • Pipelines: Ensure script error is displayed if failure occurs during pipeline execution
  • Pipelines: Fix crash in nested run project pipeline nodes validation
  • Pipelines: Fix dates relative to 'Terminal' on append data nodes
  • Pipelines: Fix datetime error in 2LS importer tasks
  • Pipelines: Fix error calculating aggregated signal
  • Pipelines: Fix error changing connected terminal to no longer pass through
  • Pipelines: Fix error passing output from 'regular' node to 'Run Project Pipeline' node
  • Pipelines: Fix error saving empty calculated kpi
  • Pipelines: Fix missing inputs validation in nested pipelines
  • Pipelines: Fix typo in validating
  • Pipelines: Improve asynchronous task description in progress bar
  • Pipelines: Improve handling of invalid connections at drawing
  • Pipelines: Improve progress reporting
  • Pipelines: Improve the way flag period is resolved
  • Pipelines: Prevent run pipeline task refering itself
  • Pipelines: Remove invalid synthesis configuration indexes from pipeline task
  • Pipelines: Set apply synthesis by default and skip synthesis if no configurations available
  • Pipelines: Skip task if Date From = Date To
  • Pipelines: Update dangling terminal display name on update dangling terminals event
  • Pipelines: Update model with current node positions when active pipeline is closed or changed
  • Pipelines: Validate selected pipeline exists before updating dangling terminals
  • Project File: Add retry logic to failed hdf5 operations
  • Project File: Correctly reset filename when file is closed
  • Project File: Ensure group names are always returned as strings
  • Properties Importer: Add control to make optional overwriting existing project data
  • Properties Importer: Fix calculated signal imported to multiple groups
  • Properties Importer: Fix copy from context menu in details tables
  • Properties Importer: Fix error overwriting nonexistent binned maps
  • Scripting Sandbox: Ensure all the values returned from api are copies
  • Scripting Sandbox: Fix 'get_flag' function
  • Scripting Sandbox: Sort scripts alphabetically
  • Sift KPI: Adding KPI for expected production dc adjusted (synthesised) normalised
  • Signal Manager: Avoid creating new group in aggregated signal script if queried signal doesn't exist
  • Signal Manager: Fix missing tz in date range including spinup
  • Signal Manager: Fix signal script not failing when querying a nonexisting supporting signal
  • Signal Manager: Fix validation in pchip interpolator patch
  • Signal Manager: Return fully qualified path when copying signal full name
  • SQL Importer: Allow importing from non-default schemas
  • SQL Importer: Fix issue with dots in schema name
  • Synthesiser: Add 'Select All' option for dimension values
  • Synthesiser: Fixes error 'ValueError: cannot set using a list-like indexer with a different length than the value'
  • Synthesiser: Improve binned map index validation errors handling
  • Timeseries: Fix discrepancy between span dates and foreground date range selector
  • Timeseries: Fix error zooming
  • Timeseries: Fix foreground date range not updating correctly at first span selection
  • Timeseries: Fix span update error
  • Timeseries: Only re-draw if axes are set correctly

Version 1.6 (20th October 2020)

Features

  • Pipelines Editor: New Pipelines Editor Module.
  • Import & Export Properties: Enable property metadata (signal settings, flags, binned maps, KPI setup, scripts) to be exported from and imported to Sift projects.
  • Heatmaps: Implement None aggregator
  • Filter String: Add flagged_as function
  • Filter String: Enable use of alias for in_poly
  • Sift Updater: Automatically check for updates when starting Sift
  • Scripting Sandbox: Expose signal's visible property through get_signal_property() function.
  • Scripting Sandbox: Expose get_api() function
  • Datetime Navigator: Scroll datetime based on latest used time span button
  • Analyse Modules: Add option to display cursor position when hovering over chart
  • Greenbyte Importer: Improve capability to download for data of new devices
  • Greenbyte Importer: Allow to set start date earlier than data already in the project file
  • KPI Manager: Add option to change order of Kpi groups
  • KPI Manager/Binned Maps: Enable save of settings without re-calculating
  • Project Data: Enable pre-pending of data in project
  • Search: Add spin-up period

Improvements and Fixes

  • Binned Map: Fix issue when one of the values is non-existent
  • Binned Map: Fix issue with year/day, year/week, year/month/day groupings
  • Binned Map: Fix issue when index is categorical dtype
  • Binned Map: Prevent invalid characters to be inserted when editing binned map manually
  • Binned Map: Disable Edit Table context menu action and Alternate View buttons in binned map view, when no table is available.
  • Signal Manager: Fixing issue with set signal for instance when whole date range not provided
  • Signal Manager: Fix issue after deleting many signals
  • Import Data: Change dateRange property in append data model to allow dates beyond dates in metadata date range.
  • Energyloss Report: Count values should be zero, not nan
  • CSV Importer: Fix exception when there are no valid timestamps
  • CSV Importer: Make csv importer return empty data frame when import result is None
  • Greenbyte Importer: warn instead of error when there is a missing signal
  • Greenbyte Importer: Fix broadcast error appending GEC data
  • KPI Manager: Fix issue with incorrect labelling of results
  • KPI Manager: Fix zero-dimensions shape exception after KPI calculation
  • KPI Manager: Ensure invalid boolean operations between kpis are caught
  • Flag Manager: Change some columns and window default sizes
  • Create Binned Map: Validate signal is selected for Data Signal groups before creating a map
  • User Kpi: Add validation to make sure Data Signal groups have signal selected before kpi calculation
  • Event Data: Fix issue with select all toggle not updating
  • Event Data: Improve performance applying 'Proportion in State Code' filter.
  • Event Data: Fix exception applying duration filter when no data was returned by current filter
  • Event Data: Fix exception deleting all event data and at launching when no event data exist.
  • Event Data: Disable invalid context menu options when no event data is selected
  • Event Data: Filter for nans when doing event/timeseries overlapping to fix issue with proportion_in_state filter
  • Data Manager: Improve thread safety.
  • Installer: Skip MSVC++ installation if already installed
  • Data Mapper: Make screen wider by default
  • Time Series: Fix discrepancy between chart dates and date range selectors
  • Heatmaps: Fix error changing plotted kpi
  • Charts: Fix axis titles not auto updating when changed in signal manager

Version 1.5 (28th May 2020)

Features

  • Binned Data: Manual edit of binned map results
  • Chronological KPI: Add year, month and day grouping
  • Event Data: Make column filter persistent for the file.
  • Heatmaps: New option in Heatmaps plot options to normalise values over rows, columns, all or none.
  • KPI Manager: Add residual deviation kpis.
  • KPI Manager: Copy the settings from existing KPI to a new KPI family.
  • KPI Manager: Move KPIs in user KPIs up and down in list.
  • Linked Controls: Allows to open fully linked modules from current plot view.
  • Main Window: Provide an 'Open recent file' shortcut from file menu.
  • Scripting Sandbox: Add query_sql function
  • Scripting Sandbox: Adds a new optional argument to get_signal API function to ignore valid range.
  • Scripting Sandbox: Extends functionality of get_instance_property to accept lists
  • Signal Manager: Adds multi-select of signals.

Improvements and Fixes

  • Background Tasks: Rework and fix threading issues in project
  • Binned Viewer: Fix issue with interval data (e.g. binned by signal)
  • Binned Viewer: New pandas index exception should be caught
  • Chronological KPI: Add year, month and day grouping; fix issue with date range
  • Create Map: Check for invalid bin settings
  • Data Synthesis: Fix issue where data was not taken into account for a wrapped data signal
  • Event Data: Fix issue adding event data to project when some rows have been dropped on import
  • Event Data: Fix issue displaying timezone-aware data
  • Event Data: Reduce the event data viewer timestamp precision. Makes it configurable using application_configuration.
  • Flag Manager: Fix application exception after importing a flag with an unexisting instance id.
  • Flag Manager: Fix issue when filtering with flag as an argument in an if statement
  • Flag Manager: Improving performance of search algorithm
  • Greenbyte Importer: Adding retries and making import more configurable
  • Greenbyte Importer: Fix issue when lat and long are invalid
  • Greenbyte Importer: Fixing import when there are no turbine devices
  • Greenbyte Importer: Improve robustness on flaky connections
  • Histogram: Fix exception swapping mast signal histogram views.
  • Histogram: Fix issue with mast data - display correct axis titles and limits. Increase precision of bin edges.
  • KPI Manager: Fix issue with mismatched series lengths
  • KPI Manager: Fixing user kpis list scrolling up on kpi select.
  • KPI Manager: Highlight current selected item in User KPIs view. Disables wrapping list around while moving items up and down.
  • KPI Manager: Improvement of UI performance.
  • KPI Visualiser: Fix issue when one index level is named 'Instance' or 'Time'
  • KPI Visualiser: Fix issue with KPI not able to be loaded. Do not load by default
  • Kpi Visualiser: Fix unhandled exception when pinned traces become invalid.
  • Launcher: Fix exception on save file when target file is locked for editing
  • Plot Legends: Ensure Histogram and Time Series legends do not reset to default values when plot data changes.
  • Plot Legends: Ensure legends names in the settings are correctly mapped to the legends shown in chart.
  • Reports: Fixes double CR at the end of lines in KPi and Signal and Flags csv reports.
  • Scripting Sandbox: Fix issue evaluating proportion_in_state for a single instance
  • Scripting Sandbox: Improves performance of scripting sandbox screen refining GUI updates.
  • Scripting Sandbox: Raise better exception when there are duplicate values
  • Sift KPI: Fix issue when no non-spurious data exists for an instance
  • Sift KPI: Fix risk evalulation period
  • Sift Startup: Fixing issue with opening sift by double clicking a file
  • Signal Manager: Avoid the lag observed editing signal notes.
  • Signal Manager: Fix exception setting signal with different time period from the instance data
  • Signal Manager: Fix signals ordering causing unexpected behavior.
  • Signal Manager: Improves new signal selection upon signal delete.
  • Synthesis Template: Index used should be same as x signal throughout

Version 1.4 (24th February 2020)

Features

  • Import data from Greenbyte Energy Cloud
  • CSV Importer: Allow date and time to be in separate columns
  • Timezone: make displayed data timezone-aware

Improvements and Fixes

  • Data Manager: Fix performance issue when setting data in the project
  • Flag Manager: Ensure latest flags are available when evaluating filter strings
  • Flag Manager: Optimising flag setting in project file
  • Flag Manager: Optimise search algorithm
  • Create Map: Fix issue re-ordering flags in flag manager
  • Event Data Viewer: Fix issue where date filter was not working in the case that a filter string was specified
  • Event Data Viewer: Fix issue when deleting added column
  • Event Data: Performance Improvements
  • Basic KPI Calculator: Fix issue when data is single float value
  • Import SQL: Fix issue with missing fractions module
  • Import CSV: Fix issue importing from large number of files
  • Import Data: Improving performance of import for large files
  • Expression Parser: Fix parsing issue when signal name contains comma
  • Startup: Fix issue with hanging on first startup

Version 1.3.0 (6th December 2019)

Features

  • New Flag Manager

Improvements and Fixes

  • Filter State: Ensure filter string functions correctly for proportion in state id
  • Scripting Sandbox: Adding instance type properties and reload modules to scripting sandbox
  • Performance: Improvements to Caching
  • Performance: Optimised import of data
  • Performance: Improve data store performance
  • KPI Manager: Adding required data signals when getting flag grouped data
  • KPI Manager: Fix issue with deleting a built-in KPI
  • KPI Manager: Adding min/max functions
  • Data Synthesis: Fix issue when trying to perform synthesis with too many dimensions
  • Import CSV: Fix some issues with appending data
  • Import CSV: Ensure date range is set correctly when adding a new signal
  • Import CSV: Adding more friendly exception for CSV importer when filename string does not contain group
  • Import SQL: Fix issue with cancellation preventing application close
  • Scatter: Fix issue with project updater on null objects
  • Scatter: Fix issue with flag presentation in x-correlation
  • Synthesis: Ensure synthesis values are saved
  • Filter String: Allow not modifiers for functions
  • Signal Manager: Better error handling when result is not a pandas series object
  • Search: Scale d2ydt2 with square of interval

Version v1.2.0 (19th July 2019)

Features

  • New file format for improved performance on very large datasets
  • Event Data viewer

Improvements and Fixes

  • TimeSeries: Fixing span at 1hz
  • TimeSeries: Improve display of 50hz data
  • Heatmap: Display center value of intervals on axis
  • Heatmap: Fixing issue with KPI access when signals are deleted
  • Heatmap: Fixing order of named instances when aggregate displayed on trace chart
  • MySQL Import: Fixing issue connecting to cloud-based services
  • WakeBlaster Integration: Updating interface for latest version
  • User KPIs: Add option to exclude KPI from output
  • Save File: Display warning before saving a file when diskspace is running low
  • KPI Manager: Fixing issue with Flags source
  • KPI Manager: Fix issues in KPI Visualiser when deleting selected KPI
  • KPI Expression: Adding if(cond, true, false) function
  • Scripting Sandbox: Add function to get project filename and directory
  • Expression Parser: Fixing if function in the case that true is a float
  • Analysis Modules: Adding plot legends to scatter, timeseries and histogram
  • Analysis Modules: Fix legend when secondary axes present
  • Legend: Visualise colors and all series in legend
  • Legend: Plot unflagged and neutral as the same series
  • Scatter Plotter: Fix error when filter string flag deleted in flag manager
  • CSV Importer: Raise error if file is invalid
  • CSV Importer: Improve input parameter validation
  • CSV Importer: Improve error when timestamp format is invalid
  • CSV Importer: Fix issue when the final signal ends with a space

Version v1.1.0 (18th January 2019)

Features

  • Adding KPI Visualisation and KPI Manager Modules, along with custom SIFT KPIs

Improvements and Fixes

  • Import Data: Adding cancel buttons to SQL and CSV importers
  • CSV Importer: Fix issue with empty lines in CSV file
  • CSV Importer: Fix issue with duplicate rows
  • Scripting Sandbox: fix issue when typing multiline strings
  • Scripting Sandbox: fix signal access when aliases are defined
  • Scripting Sandbox: specify start_date and end_date in evaluate_filter
  • Create Map: Fix alignment issue when bins have more than 3 decimal places
  • Scatter Plot: Polygon now only responds to left-click
  • Histogram: fix display of table when different numbers of bins in foreground and background data
  • Error Reporting: Use outlook interface directly to improve reliability
  • Signal Manager: Fix issue adding multiple aggregated signals when mast signals are defined
  • Add option to display grid lines and change axis limits

Version v1.0.3 (25th October 2018)

Features

  • Adding Script Sandbox
  • Import CSV: enable signal IDs to be defined in rows

Improvements and Fixes

  • Import CSV: Add progress reporting to csv import
  • SQL Importer: Adding labels to source configuration
  • Autosave: change default autosave interval to 10 minutes and decrease priority
  • Search: Updating filter string validation when filter string changes
  • Create Map: Adding index to map to improve at-a-glance identification
  • Create Map: Fix use of $h filter
  • Create Map: Fix issue with missing index when a supporting signal is used for the X bins and some instances are filtered out
  • Export KPI: Fix issue with mast filter
  • Signal Manager: Fix issue creating signal ID containing a colon
  • Direction Calibration: make color of instance markers the same as the axes colors
  • Custom Chart Colors: Fixing secondary axes and highlights/stdev in Binned Map viewer
  • Custom Chart Colors: Make color of polygon same as foreground axes color
  • Filter String: Fix issue with space in date filter e.g. $h<1
  • Export Basic KPI: Set count to zero instead of empty when value is null
  • Histogram: Axis titles now use instance and signal display name when in difference mode
  • Energy Loss: Set count to zero instead of empty when value is null
  • Reporting: Generate default names for reports
  • Energy Loss Report: Adding filter string to summary page

Version v1.0.2 (29th August 2018)

Features

  • Adding release notes
  • Adding append functionality to SQL importer and CSV importer
  • Enable customisation of chart background and axes colors

Improvements and Fixes

  • Share axes on histogram when difference is displayed
  • Fix for MySQL importer: force type to be datetime in min_max function
  • Update axis names to be more readable in binned viewer
  • Change color of Update Map button to draw attention to it
  • Make histogram difference view cross-correlation the same as scatter view
  • Normalise foreground and background data in histogram to selected date range
  • Fix issue with data synthesiser: keep existing value by default
  • Make default log level info to improve general performance
  • Create Map: ensure that all possible bins for any mapping dimension are present in the map result
  • Energy Loss KPI: exclude data outside of invalid range
  • Unsaved changes dialog: ensure user is warned of unsaved changes
  • Filtering: fix issue using flag filter on aggregate and mast data
  • CSV Importer: ensure that instance ID can be read from column name when importing from a directory
  • Energy Loss: add option to set expected to observed for normal operation
  • Energy Loss: Fix issue creating energy loss calculation when flag filter defined
  • Signal Manager: fix issue creating synthesised signal from map grouped by flag
  • Change names on csv impoter from Instances/Signals -> Select Instances/Select Signals
  • Signal Manager: Fix copy full name/alias of supporting data signal
  • Fix issue with supporting signals in histogram viewer
  • Fix issue with 0.1> buttons
  • CSV Importer: Fix issue in CSV importer when column ID pattern has arbitrary characters
  • CSV Importer: Enable importing different signals from multiple files
  • Improving reliability of file saving
  • Energy Loss: Fixing energy loss valid range when filter applied
  • CSV Imporeter: Fixing issue with CSV importer with signal ids in multiple files, instance ID in column
  • Performance: Do not update properties when changing signals
  • Performance: Only autosave when autosave file is out of date

Version v1.0.1 (26th July 2018)

Improvements and Fixes

  • Fix histogram limits checking
  • Fix axis limits - do not allow infs
  • Fix operator precedence in filter string
  • Fix histogram bin centers on data table
  • Fix timeseries zoom in limit
  • Fix csv importer issue
  • Fix nan in energy loss calculator
  • Fix csv importer for tabs
  • Fix csv importer error: ignore encoding errors in imported csv, ensure that duplicate columns are ignored
  • Added section for "delimited text file importer" to user manual
  • Ignore encoding errors in imported csv
  • Ensure that duplicate columns are ignored in csv importer
  • Fix mysql connection when no access to sys database, and improve error messages

Version v1.0.0 (1st July 2018)

  • First release