Found a bug where holes inside an island do not get flattened properly. Two perfectly matching islands one with and without holes, will be optimized to slightly different scales. While the shape seems correct there is a slight difference in overall scale and color, indicating stretching.
Current workaround is to make release cuts between the hole and the island perimeter. After that setting the required texel density or sometimes re-optimizing the island will fix this.