Ingestion_parallel module

class ingestion_parallel.Ingestion(data=None)

Bases: object

Class for handling the ingestion process.

Args:

data (object): The data object.

Attributes:

  • start_time (datetime): The start time of the ingestion process.

  • end_time (datetime): The end time of the ingestion process.

  • model (object): The model object.

  • data (object): The data object.

Methods:

  • start_timer: Start the timer for the ingestion process.

  • stop_timer: Stop the timer for the ingestion process.

  • get_duration: Get the duration of the ingestion process.

  • save_duration: Save the duration of the ingestion process to a file.

  • load_train_set: Load the training set.

  • init_submission: Initialize the submitted model.

  • fit_submission: Fit the submitted model.

  • predict_submission: Make predictions using the submitted model.

  • compute_result: Compute the ingestion result.

  • save_result: Save the ingestion result to a file.

compute_result()

Compute the ingestion result.

fit_submission()

Fit the submitted model.

get_duration()

Get the duration of the ingestion process.

Returns:

timedelta: The duration of the ingestion process.

init_submission(Model)

Initialize the submitted model.

Args:

Model (object): The model class.

load_train_set(**kwargs)

Load the training set.

Returns:

object: The loaded training set.

predict_submission(test_settings, initial_seed=31415)

Make predictions using the submitted model.

Args:

test_settings (dict): The test settings.

save_duration(output_dir=None)

Save the duration of the ingestion process to a file.

Args:

output_dir (str): The output directory to save the duration file.

save_result(output_dir=None)

Save the ingestion result to files.

Args:

output_dir (str): The output directory to save the result files.

start_timer()

Start the timer for the ingestion process.

stop_timer()

Stop the timer for the ingestion process.