tests

test_api_views.py

Tests for the api_views module in the jwql web application.

Authors

• Matthew Bourque

• Bryan Hilbert

• Melanie Clarke

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_api_views.py

jwql.tests.test_api_views.test_api_views(url)

Test to see if the given url returns a populated JSON object

Parameters:

urlstr

The url to the api view of interest (e.g. http://127.0.0.1:8000/api/86700/filenames/').

test_bad_pixel_monitor.py

Tests for the bad pixel monitor module.

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_badpix_monitor.py

jwql.tests.test_bad_pixel_monitor.test_add_bad_pix()

jwql.tests.test_bad_pixel_monitor.test_bad_map_to_list()

Check that bad pixel locations are correctly retrieved from an image

jwql.tests.test_bad_pixel_monitor.test_check_for_sufficient_files()

Be sure that the file threshold values are being used correctly

jwql.tests.test_bad_pixel_monitor.test_exclude_crds_mask_pix()

Test that bad pixel images are differentiated correctly

jwql.tests.test_bad_pixel_monitor.test_exclude_existing_badpix()

jwql.tests.test_bad_pixel_monitor.test_filter_query_results()

Test MAST query filtering to extract most common filter/pupil and acceptable readout patterns

jwql.tests.test_bad_pixel_monitor.test_get_possible_apertures(instrument, expected_list)

Make sure the correct apertures are returned for the given instrument

jwql.tests.test_bad_pixel_monitor.test_identify_tables()

Be sure the correct database tables are identified

jwql.tests.test_bad_pixel_monitor.test_locate_rate_files()

Test that rate files are found in filesystem

jwql.tests.test_bad_pixel_monitor.test_locate_uncal_files()

Test the filesystem search for uncal files

jwql.tests.test_bad_pixel_monitor.test_make_crds_parameter_dict()

Test that the dictionary to be used for CRDS queries is properly created

test_bias_monitor.py

Tests for the bias_monitor module.

Authors

• Ben Sunnquist

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_bias_monitor.py

jwql.tests.test_bias_monitor.test_collapse_image()

Test that the image is collapsed correctly along its axes

jwql.tests.test_bias_monitor.test_extract_zeroth_group()

Test the zeroth group file creation

jwql.tests.test_bias_monitor.test_get_amp_medians()

Test that the amp medians are calculated correctly

jwql.tests.test_bias_monitor.test_identify_tables()

Be sure the correct database tables are identified

jwql.tests.test_bias_monitor.test_make_histogram()

Test histogram creation

jwql.tests.test_bias_monitor.test_process(mocker, tmp_path)

test_calculations.py

Tests for the calculations module.

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_calculations.py

jwql.tests.test_calculations.test_double_gaussian_fit()

Test the double Gaussian fitting function

jwql.tests.test_calculations.test_gaussian1d_fit()

Test histogram fitting function

jwql.tests.test_calculations.test_mean_image()

Test the sigma-clipped mean and stdev image calculator

jwql.tests.test_calculations.test_mean_stdev()

Test calcualtion of the sigma-clipped mean from an image

test_dark_monitor.py

Tests for the dark_monitor module.

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_dark_monitor.py

jwql.tests.test_dark_monitor.generate_data_for_file_splitting_test()

jwql.tests.test_dark_monitor.test_add_bad_pix()

jwql.tests.test_dark_monitor.test_exclude_existing_badpix()

jwql.tests.test_dark_monitor.test_find_hot_dead_pixels()

Test hot and dead pixel searches

jwql.tests.test_dark_monitor.test_get_metadata()

Test retrieval of metadata from input file

jwql.tests.test_dark_monitor.test_mast_query_darks()

Test that the MAST query for darks is functional

jwql.tests.test_dark_monitor.test_noise_check()

Test the search for noisier than average pixels

jwql.tests.test_dark_monitor.test_shift_to_full_frame()

Test pixel coordinate shifting to be in full frame coords

jwql.tests.test_dark_monitor.test_split_files_into_sub_lists(files, start_times, end_times, integration_list, threshold, expected)

Test that file lists are appropriately split into subgroups for separate monitor runs

test_data_containers.py

Tests for the data_containers module in the jwql web application.

Authors

• Matthew Bourque

• Mees Fix

• Bryan Hilbert

• Bradley Sappington

• Melanie Clarke

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_data_containers.py

jwql.tests.test_data_containers.test_build_table()

jwql.tests.test_data_containers.test_create_archived_proposals_context(tmp_path, mocker)

jwql.tests.test_data_containers.test_filter_root_files(filter_keys)

jwql.tests.test_data_containers.test_filter_root_files_sorting()

jwql.tests.test_data_containers.test_get_acknowledgements()

Tests the get_acknowledgements function.

jwql.tests.test_data_containers.test_get_additional_exposure_info()

Tests get_additional_exposure_info function.

jwql.tests.test_data_containers.test_get_all_proposals()

Tests the get_all_proposals function.

jwql.tests.test_data_containers.test_get_available_suffixes(untracked, input_suffixes, expected)

jwql.tests.test_data_containers.test_get_dashboard_components()

jwql.tests.test_data_containers.test_get_expstart(inst, fileroot, value)

Tests the get_expstart function.

jwql.tests.test_data_containers.test_get_filenames_by_instrument()

Tests the get_filenames_by_instrument function.

jwql.tests.test_data_containers.test_get_filenames_by_proposal()

Tests the get_filenames_by_proposal function.

jwql.tests.test_data_containers.test_get_filenames_by_rootname()

Tests the get_filenames_by_rootname function.

jwql.tests.test_data_containers.test_get_filesystem_filenames(pid, rname, success)

Tests the get_filesystem_filenames function.

jwql.tests.test_data_containers.test_get_filesystem_filenames_options()

Tests the get_filesystem_filenames function.

jwql.tests.test_data_containers.test_get_header_info()

Tests the get_header_info function.

jwql.tests.test_data_containers.test_get_image_info()

Tests the get_image_info function.

jwql.tests.test_data_containers.test_get_instrument_looks(keys, viewed, sort_as, exp_type, cat_type)

Tests the get_instrument_looks function.

jwql.tests.test_data_containers.test_get_instrument_proposals()

Tests the get_instrument_proposals function.

jwql.tests.test_data_containers.test_get_preview_images_by_proposal()

Tests the get_preview_images_by_proposal function.

jwql.tests.test_data_containers.test_get_preview_images_by_rootname()

Tests the get_preview_images_by_rootname function.

jwql.tests.test_data_containers.test_get_proposal_info()

Tests the get_proposal_info function.

jwql.tests.test_data_containers.test_get_proposals_by_category()

Tests the get_proposals_by_category function.

jwql.tests.test_data_containers.test_get_thumbnail_by_rootname()

Tests the get_thumbnail_by_rootname function.

jwql.tests.test_data_containers.test_get_thumbnails_by_proposal()

Tests the get_thumbnails_by_proposal function.

jwql.tests.test_data_containers.test_mast_query_by_rootname()

Tests the mast_query_by_rootname function.

jwql.tests.test_data_containers.test_thumbnails_ajax()

Tests the get_thumbnails_ajax function.

test_database_interface.py

Tests for the database_interface.py module.

Authors

• Joe Filippazzo

• Matthew Bourque

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s database_interface.py

jwql.tests.test_database_interface.test_all_tables_exist()

Test that the table ORMs defined in database_interface actually exist as tables in the database

jwql.tests.test_database_interface.test_anomaly_orm_factory()

Test that the anomaly_orm_factory function successfully creates an ORM and contains the appropriate columns

jwql.tests.test_database_interface.test_anomaly_records()

Test to see that new records can be entered

jwql.tests.test_database_interface.test_load_connections()

Test to see that a connection to the database can be established

jwql.tests.test_database_interface.test_monitor_orm_factory()

Test that the monitor_orm_factory function successfully creates an ORM and contains the appropriate columns

test_edb.py

Tests for the engineering_database module.

Authors

• Johannes Sahlmann

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_edb.py

jwql.tests.test_edb.test_add()

Test addition (i.e. concatenation) of two EdbMnemonic objects

jwql.tests.test_edb.test_change_only_bounding_points()

Make sure we correctly add starting and ending time entries to a set of change-only data

jwql.tests.test_edb.test_daily_stats()

Test that the daily statistics are calculated correctly

jwql.tests.test_edb.test_full_stats()

Test that the statistics calculated over the entire data set are correct

jwql.tests.test_edb.test_get_mnemonic()

Test the query of a single mnemonic.

jwql.tests.test_edb.test_get_mnemonic_info()

Test retrieval of mnemonic info.

jwql.tests.test_edb.test_get_mnemonics()

Test the query of a list of mnemonics.

jwql.tests.test_edb.test_interpolation()

Test interpolation of an EdbMnemonic object

jwql.tests.test_edb.test_interpolation_change_only()

Test interpolation of change-only data

jwql.tests.test_edb.test_multiplication()

Test multiplication of two EdbMnemonic objects

jwql.tests.test_edb.test_timed_stats()

Break up data into chunks of a given duration

test_edb_telemetry_monitor.py

Tests for the EDB telemetry

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_edb_telemetry_monitor.py

jwql.tests.test_edb_telemetry_monitor.test_add_every_change_history()

Test that every_change data is correctly combined with an existing set of every_change data

jwql.tests.test_edb_telemetry_monitor.test_add_new_block_db_entry()

jwql.tests.test_edb_telemetry_monitor.test_add_new_every_change_db_entry()

jwql.tests.test_edb_telemetry_monitor.test_change_only_add_points()

Make sure we convert change-only data to AllPoints data correctly

jwql.tests.test_edb_telemetry_monitor.test_conditions()

Test the extraction of data using the `equal` class.

jwql.tests.test_edb_telemetry_monitor.test_find_all_changes()

jwql.tests.test_edb_telemetry_monitor.test_get_averaging_time_duration()

Test that only allowed string formats are used for averaging time duration

jwql.tests.test_edb_telemetry_monitor.test_get_query_duration()

Test that the correct query duration is found

jwql.tests.test_edb_telemetry_monitor.test_key_check()

Test the dictionary key checker

jwql.tests.test_edb_telemetry_monitor.test_multiple_conditions()

Test that filtering using multiple conditions is working as expected.

jwql.tests.test_edb_telemetry_monitor.test_organize_every_change()

Test the reorganization of every_change data from an EdbMnemonic into something easier to plot

jwql.tests.test_edb_telemetry_monitor.test_remove_outer_points()

Test that points outside the requested time are removed for change-only data

test_instrument_properties.py

Tests for the instrument_properties module.

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_instrument_properties.py

jwql.tests.test_instrument_properties.test_amplifier_info()

Test that the correct number of amplifiers are found for a given file

jwql.tests.test_instrument_properties.test_calc_frame_time()

Test calcuation of frametime for a given instrument/aperture

test_loading_times.py

Tests various webpages of the jwql web application to make sure that loading times are not too long

Authors

• Matthew Bourque

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_loading_times.py

jwql.tests.test_loading_times.test_loading_times(url)

Test to see if the given url returns a webpage successfully within a reasonable time.

Parameters:

urlstr

The url to the webpage of interest (e.g. http://127.0.0.1:8000/fgs/archive/').

test_logging_functions.py

Tests for the logging_functions module.

Authors

• Matthew Bourque

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_logging_functions.py

jwql.tests.test_logging_functions.perform_basic_logging()

Performs some basic logging to the test log file

jwql.tests.test_logging_functions.test_configure_logging()

Assert that the configure_logging function successfully creates a log file

jwql.tests.test_logging_functions.test_logging_functions()

A generic end-to-end test that creates a log file, does some basic logging, then asserts that some logging content exists

jwql.tests.test_logging_functions.test_make_log_file()

Assert that make_log_file function returns the appropriate path for a log file

test_mast_utils.py

Tests for the mast_utils module.

Authors

Joe Filippazzo

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_mast_utils.py

jwql.tests.test_mast_utils.test_astroquery_mast()

Test if the astroquery.mast service can complete a request

jwql.tests.test_mast_utils.test_caom_instrument_keywords()

Test to see that the CAOM keywords are the same for all instruments

jwql.tests.test_mast_utils.test_filtered_instrument_keywords()

Test to see that the instrument specific service keywords are different for all instruments

jwql.tests.test_mast_utils.test_instrument_dataproduct_filtering()

Test to see that the instrument inventory can be filtered by data product

jwql.tests.test_mast_utils.test_instrument_inventory_filtering()

Test to see that the instrument inventory can be filtered

test_permissions.py

Tests for the permissions module.

Authors

• Johannes Sahlmann

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_permissions.py

jwql.tests.test_permissions.test_directory(test_dir='/home/docs/permission_test')

Create a test directory for permission management.

Parameters:

test_dirstr

Path to directory used for testing

Yields:

test_dirstr

Path to directory used for testing

jwql.tests.test_permissions.test_directory_permissions(test_directory)

Create a directory with the standard permissions ('-rw-r--r--').

Set the default permissions defined in permissions.py. Assert that these were set correctly.

Parameters:

test_directorystr

Path of directory used for testing

jwql.tests.test_permissions.test_file(test_dir='/home/docs/permission_test')

Create a test file for permission management.

Parameters:

test_dirstr

Path to directory used for testing

Yields:

filenamestr

Path of file used for testing

jwql.tests.test_permissions.test_file_group(test_file)

Create a file with the standard permissions ('-rw-r--r--') and default group.

Modify the group and set the default permissions defined in permissions.py. Assert that both group and permissions were set correctly.

Parameters:

test_filestr

Path of file used for testing

jwql.tests.test_permissions.test_file_permissions(test_file)

Create a file with the standard permissions ('-rw-r--r--').

Set the default permissions defined in permissions.py. Assert that these were set correctly.

Parameters:

test_filestr

Path of file used for testing

test_pipeline_tools.py

Tests for the pipeline_tools module.

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_pipeline_tools.py

jwql.tests.test_pipeline_tools.test_completed_pipeline_steps()

Test that the list of completed pipeline steps for a file is correct

Parameters:

filenamestr

File to be checked

jwql.tests.test_pipeline_tools.test_get_pipeline_steps()

Test that the proper pipeline steps are returned for an instrument

jwql.tests.test_pipeline_tools.test_image_stack()

Test stacking of slope images

jwql.tests.test_pipeline_tools.test_steps_to_run()

Test that the dictionaries for steps required and steps completed are correctly combined to create a dictionary of pipeline steps to be done

Parameters:

filenamestr

File to be checked

requiredOrderedDict

Dict of all pipeline steps to be run on filename

already_doneOrderedDict

Dict of pipeline steps already run on filename

test_plotting.py

Tests for the plotting module.

Authors

• Joe Filippazzo

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_plotting.py

jwql.tests.test_plotting.test_bar_chart()

Make sure some dummy data generates a bokeh plot

jwql.tests.test_plotting.test_bokeh_version()

Make sure that the current version of Bokeh matches the version being used in all the web app HTML templates.

test_preview_image.py

Tests for the preview_image module.

Authors

• Johannes Sahlmann

• Lauren Chambers

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_preview_image.py

jwql.tests.test_preview_image.get_test_fits_files()

Get a list of the FITS files on central storage to make preview images.

Returns:

filenameslist

List of filepaths to FITS files

jwql.tests.test_preview_image.test_crop_to_subarray()

Test that the code correctly crops larger arrays down to the requested subarray

jwql.tests.test_preview_image.test_get_nonsci_map()

Test the retrieval of the dq data from an HDUList

jwql.tests.test_preview_image.test_make_image(tmp_path, filename)

Use PreviewImage.make_image to create preview images of a sample JWST exposure.

Assert that the number of JPGs created corresponds to the number of integrations.

Parameters:

tmp_pathpathlib.Path

Temporary directory to write to

filenamestr

Path of FITS image to generate preview of

test_readnoise_monitor.py

Tests for the readnoise_monitor module.

Authors

• Ben Sunnquist

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_readnoise_monitor.py

jwql.tests.test_readnoise_monitor.test_determine_pipeline_steps()

Test the correct pipeline steps are called

jwql.tests.test_readnoise_monitor.test_get_amp_stats()

Test amp stat calculations

jwql.tests.test_readnoise_monitor.test_get_metadata()

Test retrieval of metadata from input file

jwql.tests.test_readnoise_monitor.test_identify_tables()

Be sure the correct database tables are identified

jwql.tests.test_readnoise_monitor.test_make_histogram()

Test histogram creation

jwql.tests.test_readnoise_monitor.test_make_readnoise_image()

Test readnoise image creation

jwql.tests.test_readnoise_monitor.test_process(mocker, tmp_path)

test_setup.py

Tests for the setup.py module.

Authors

• Bryan Hilbert

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_setup_info.py

jwql.tests.test_setup.test_version_number()

Test that the JWQL version number is retrieved from setup.py

test_utils.py

Tests for the utils module.

Authors

• Lauren Chambers

• Matthew Bourque

Use

These tests can be run via the command line (omit the -s to suppress verbose output to stdout):

pytest -s test_utils.py

jwql.tests.test_utils.test_copy_files()

Test that files are copied successfully

jwql.tests.test_utils.test_filename_parser(filename, solution)

Generate a dictionary with parameters from a JWST filename. Assert that the dictionary matches what is expected.

Parameters:

filenamestr

The filename to test (e.g. jw00327001001_02101_00002_nrca1_rate.fits)

solutiondict

A dictionary of the expected result

jwql.tests.test_utils.test_filename_parser_non_jwst()

Attempt to generate a file parameter dictionary from a file that is not formatted in the JWST naming convention. Ensure the appropriate error is raised.

jwql.tests.test_utils.test_filename_parser_whole_filesystem()

Test the filename_parser on all files currently in the filesystem.

jwql.tests.test_utils.test_filesystem_path()

Test that a file’s location in the filesystem is returned

jwql.tests.test_utils.test_get_config()

Assert that the get_config function successfully creates a dictionary.

jwql.tests.test_utils.test_save_png()

Test that we can create a png file

jwql.tests.test_utils.test_validate_config()

Test that the config validator works.