KaneAI - World’s First E2E Software Testing Agent.Book a Demo Join TestMu Conference

How to use clean_foreign_keys method in autotest

Best Python code snippet using autotest_python

clean_table.py

Source:clean_table.py

...7import os8def clean_table(settings, foreign_keys, table):9    print("START CLEANING TABLE " + table.name)10    df_to_clean = table.df.copy()11    cleaned_df = clean_foreign_keys(settings.on_foreign_key_violation, table.name, df_to_clean, foreign_keys)12    cleaned_df = clean_denial_constraints(settings.on_denial_constraint_violation, table, cleaned_df)13    if not settings.on_functional_dependency_violation == OnFunctionalDependencyViolation.IGNORE:14        cleaned_df = clean_functional_dependencies(settings.on_functional_dependency_violation, table, cleaned_df)15    cleaned_df = clean_dates(table, cleaned_df)16    cleaned_df = clean_duplicates(settings.on_duplicate_detect, table, cleaned_df)17    cleaned_df = clean_outliers(table, cleaned_df)18    cleaned_df = clean_null_values(table, cleaned_df)19    cleaned_df = clean_clustered_columns(table, cleaned_df)20    path = table.path21    cleaned_at = datetime.now().strftime("%Y-%m-%d--%H-%M-%S")22    filename = table.name + "_CLEANED_" + cleaned_at + ".csv"23    path_and_filename = os.path.join(path, filename)24    cleaned_df.to_csv(path_and_filename, index=False)25    print("FINISHED CLEANING TABLE: saving cleaned table to " + path_and_filename)26def clean_foreign_keys(on_fk_violation_action, table_name, df, foreign_keys):27    if on_fk_violation_action == OnForeignKeyViolation.IGNORE:28        return df29    try:30        df_copy = df.copy()31        fks = foreign_keys.get_fks_with_violations(table_name)32        if len(fks) == 0:33            if on_fk_violation_action == OnForeignKeyViolation.FLAG:34                df_copy["FOREIGN_KEY_VIOLATION"] = False35                df_copy["FOREIGN_KEY_VIOLATION_INFO"] = ""36            return df_copy37        if on_fk_violation_action == OnForeignKeyViolation.FLAG:38            flag = pd.Series(np.full(len(df_copy.index), False), index=df_copy.index)39            flag_message = pd.Series([''] * len(df_copy.index), index=df_copy.index)40            for fk in fks:...

rdb_model_extensions.py

Source:rdb_model_extensions.py

...26            for field in cls._meta.fields:27                cls.field_dict[field.name] = field28        return cls.field_dict29    @classmethod30    def clean_foreign_keys(cls, data):31        """\32        -Convert foreign key fields in data from <field>_id to just33        <field>.34        -replace foreign key objects with their IDs35        This method modifies data in-place.36        """37        for field in cls._meta.fields:38            if not field.rel:39                continue40            if (field.attname != field.name and41                field.attname in data):42                data[field.name] = data[field.attname]43                del data[field.attname]44            if field.name not in data:...

Automation Testing Tutorials

Learn to execute automation testing from scratch with LambdaTest Learning Hub. Right from setting up the prerequisites to run your first automation test, to following best practices and diving deeper into advanced test scenarios. LambdaTest Learning Hubs compile a list of step-by-step guides to help you be proficient with different test automation frameworks i.e. Selenium, Cypress, TestNG etc.