Problem:
TF Dataloader produces shapes that make serving the model difficult. Models has code to take this awkward shape and rework it to what the model actually requires, but the serving signature it saves is the input from the dataloader. This code should be moved upstream into the dataloader so it doesn't need to be repeated at inference time.
Goal:
- Models
- Dataloader
- Add code for reshaping the tensor to the correct shape into the dataloader in (_to_tensor)
- Use the code from Merlin models schema that distinguishes between list columns to only apply this in the appropriate place.
Constraints:
Only want to apply the transform in the appropriate place, requiring schema awareness.
Problem:
TF Dataloader produces shapes that make serving the model difficult. Models has code to take this awkward shape and rework it to what the model actually requires, but the serving signature it saves is the input from the dataloader. This code should be moved upstream into the dataloader so it doesn't need to be repeated at inference time.
Goal:
Constraints:
Only want to apply the transform in the appropriate place, requiring schema awareness.