I am assuming you used vanilla embeddings in your first ablation experiment on the number of encoder-decoder layers. Moreover, the paper states that it uses #layers=2 for further experiments.
In that case, shouldn't the results in Table-3 (for #layers = 2) match the results in Table-5 (for vanilla embedding)?
For example, the BLEU-4 score (for test set) in Table-3 is 21.65, and in Table-5, is 22.22. Shouldn't these not be different?
I am assuming you used vanilla embeddings in your first ablation experiment on the number of encoder-decoder layers. Moreover, the paper states that it uses #layers=2 for further experiments.
In that case, shouldn't the results in Table-3 (for #layers = 2) match the results in Table-5 (for vanilla embedding)?
For example, the BLEU-4 score (for test set) in Table-3 is 21.65, and in Table-5, is 22.22. Shouldn't these not be different?