U.S. Trade Representative Robert Lighthizer will visit Japan on May 24 to meet with Economy Minister Toshimitsu Motegi to accelerate trade talks ahead of a summit meeting scheduled a few days later, two sources with direct knowledge of the plan said on Monday.