Skip to content

Add Table structure evaluations for TEDS #94

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

praveenmidde
Copy link
Contributor

As of now, the "evaluations" hold independent results of tables for TEDS only. Extend it to include the values of TEDS_struct evaluations as well.

  1. TableEvaluation class is extended to have another flag "is_structure_only" to distinguish between TEDS & TEDS_struct => The existing field "TEDS" will be the score as-is.
  2. Append the table_struct_evaluations as well into the result.

@praveenmidde praveenmidde self-assigned this May 8, 2025
@praveenmidde praveenmidde force-pushed the p_addStructOnlyResultsIntoEvaluations branch from e106bbe to bf29960 Compare May 8, 2025 05:16
@praveenmidde praveenmidde force-pushed the p_addStructOnlyResultsIntoEvaluations branch from c6ec8a9 to e3997a8 Compare May 8, 2025 08:29
Signed-off-by: Praveen Kumar Midde <praveen.midde@gmail.com>
Signed-off-by: Praveen Kumar Midde <praveen.midde@gmail.com>
…tion

Signed-off-by: Praveen Kumar Midde <praveen.midde@gmail.com>
@praveenmidde praveenmidde force-pushed the p_addStructOnlyResultsIntoEvaluations branch from 22c545d to 1d4579a Compare May 12, 2025 12:06
Copy link
Contributor

@PeterStaar-IBM PeterStaar-IBM left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see comments

@@ -42,6 +43,7 @@ class TableEvaluation(UnitEvaluation):

class DatasetTableEvaluation(DatasetEvaluation):
evaluations: List[TableEvaluation]
structure_only_evaluations: Optional[List[TableEvaluation]] = None
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's call the variable table_structure_evaluations and do not make it optional.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants