STEP EDITOR FOR DATA PREPARATION

摘要

Using a step editor for data preparation includes: receiving an indication of a user input with respect to at least some of a set of sequenced data preparation operations on a set of data; generating, using one or more processors, a signature based at least in part on the set of sequenced data preparation operations, references to the set of data, and the user input; using the generated signature to determine whether there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input; based at least in part on the determination, obtaining a data traversal program representing a result associated with the set of sequenced operations, the references to the set of data, and the user input; and providing output based at least in part on the result represented by the obtained data traversal program.

主权项

1. A system, comprising:
one or more processors configured to:
receive an indication of a user input with respect to at least some of a set of sequenced data preparation operations on a set of data;generate a signature based at least in part on the set of sequenced data preparation operations, references to the set of data, and the user input;use the generated signature to determine whether there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input;based at least in part on the determination, obtain a data traversal program representing a result associated with the set of sequenced operations, the references to the set of data, and the user input; andprovide output based at least in part on the result represented by the obtained data is traversal program; and a memory coupled to the one or more processors and configured to provide the one or more processors with instructions.