How can we visualize the Chinese poetry’s artistic conception?

It’s really hard to translate ‘意境’ the imagery carrying by chinese sentence， Can AI help us do that and help non-Chinese learner learn about Chinese poetry？

LORA: https://civitai.com/models/296905/chinese-ink-painting

林尽水源，便得一山，山有小口，仿佛若有光。

At the end of the forest where the spring originated, there was a mountain. In the mountain was a small opening, seemingly emitting a faint light.

Img to Img with prompt from poetry….Pretty accurate but a little bit boring to me cause there’s nothing new out of my expectation

Img to Img with prompt from poetry….Pretty accurate but a little bit boring to me cause there’s nothing new out of my expectation

image.png

Inpainting experiment still glitch but probably I am on the right direction

Inpainting experiment still glitch but probably I am on the right direction

Then I came up two ways of visualization

  1. Extract Chinese Words entity，

林尽 end of the forest

image.png

image.png

image.png

水源 the forest where the spring originated

image.png

image.png

image.png

便得一山 there was a mountain

image.png

image.png

image.png

山有小口 In the mountain was a small opening

image.png

image.png

image.png