No CrossRef data available.
Article contents
Intermittent swimmers optimize energy expenditure with flick-to-flick motor control
Published online by Cambridge University Press: 10 March 2025
Abstract
Intermittent swimming behaviour is commonly observed in larval zebrafish, often attributed to energy-saving mechanisms. In this study, we utilize a hybrid approach combining deep reinforcement learning and the immersed boundary–lattice Boltzmann method to train a larval zebrafish-like swimmer to reach a target with minimized energy expenditure. We find that when the tail-beat period is fixed, continuous swimming emerges as the optimal strategy. However, when the tail-beat period is allowed to vary, intermittent swimming proves superior in energy performance, achieved through reductions in tail-beat amplitude and frequency. Our detailed analysis reveals that intermittent swimmers employ rapid backward tail flicks to attain high speeds, coupled with slower forward tail flicks and coasting phases to conserve energy. Furthermore, we derive scaling laws governing the swimming performance of trained fish. These results offer valuable insights into the intermittent swimming patterns of fish, with implications for understanding bio-inspired locomotion and informing the design of energy-efficient aquatic systems.
JFM classification
- Type
- JFM Papers
- Information
- Copyright
- © The Author(s), 2025. Published by Cambridge University Press
Footnotes
†
Y. Zhu and L. Kang contributed equally to this work and should be considered co-first authors.
References
Akoz, E., Han, P., Liu, G., Dong, H.B. & Moored, K.W. 2019 Large-amplitude intermittent swimming in viscous and inviscid flows. AIAA J. 57 (9), 3678–3685.CrossRefGoogle Scholar
Akoz, E., Mivehchi, A. & Moored, K.W. 2021 Intermittent unsteady propulsion with a combined heaving and pitching foil. Phys. Rev. Fluids 6 (4), 043101.CrossRefGoogle Scholar
Akoz, E. & Moored, K.W. 2018 Unsteady propulsion by an intermittent swimming gait. J. Fluid Mech. 834, 149–172.CrossRefGoogle Scholar
Ashraf, I., Van Wassenbergh, S. & Verma, S. 2020 Burst-and-coast swimming is not always energetically beneficial in fish (Hemigrammus bleheri). Bioinspir. Biomim. 16 (1), 016002.CrossRefGoogle Scholar
Bale, R., Hao, M., Bhalla, A.P.S. & Patankar, N.A. 2014 Energy efficiency and allometry of movement of swimming and flying animals. Proc. Natl Acad. Sci. USA 111 (21), 7517–7521.CrossRefGoogle ScholarPubMed
Borla, M.A., Palecek, B., Budick, S. & O’Malley, D.M. 2002 Prey capture by larval zebrafish: evidence for fine axial motor control. Brain Behav. Evol. 60 (4), 207–229.CrossRefGoogle ScholarPubMed
Bottom II, R.G., Borazjani, I., Blevins, E.L. & Lauder, G.V. 2016 Hydrodynamics of swimming in stingrays: numerical simulations and the role of the leading-edge vortex. J. Fluid Mech. 788, 407–443.CrossRefGoogle Scholar
Chung, M.H. 2009 On burst-and-coast swimming performance in fish-like locomotion. Bioinspir. Biomim. 4 (3), 036001.CrossRefGoogle ScholarPubMed
Colabrese, S., Gustavsson, K., Celani, A. & Biferale, L. 2017 Flow navigation by smart microswimmers via reinforcement learning. Phys. Rev. Lett. 118 (15), 158004.CrossRefGoogle ScholarPubMed
Coughlin, D.J., Chrostek, J.D. & Ellerby, D.J. 2022 Intermittent propulsion in largemouth bass, Micropterus salmoides, increases power production at low swimming speeds. Biol. Lett. 18 (5), 20210658.CrossRefGoogle ScholarPubMed
Cui, X.Y., Sun, B.A., Zhu, Y., Yang, N., Zhang, H.F., Cui, W.C., Fan, D.X. & Wang, J. 2024 Enhancing efficiency and propulsion in bio-mimetic robotic fish through end-to-end deep reinforcement learning. Phys. Fluids 36 (3), 031910.CrossRefGoogle Scholar
Dai, L.Z., He, G.W., Zhang, X. & Zhang, X. 2018 Intermittent locomotion of a fish-like swimmer driven by passive elastic mechanism. Bioinspir. Biomim. 13 (5), 056011.CrossRefGoogle ScholarPubMed
Fan, D.X., Yang, L., Wang, Z.C., Triantafyllou, M.S. & Karniadakis, G.E. 2020 Reinforcement learning for bluff body active flow control in experiments and simulations. Proc. Natl Acad. Sci. USA 117 (42), 26091–26098.CrossRefGoogle ScholarPubMed
Fish, F.E. & Rohr, J.J. 1999 Review of Dolphin Hydrodynamics and Swimming Performance. SSC San Diego.CrossRefGoogle Scholar
Floryan, D., Van Buren, T. & Smits, A.J. 2017 Forces and energetics of intermittent swimming. Acta Mechanica Sin. 33 (4), 725–732.CrossRefGoogle Scholar
Garrick, I. 1936 Propulsion of a flapping and oscillating airfoil. NACA Tech. Rep. 567.Google Scholar
Gazzola, M., Argentina, M. & Mahadevan, L. 2014 a Scaling macroscopic aquatic locomotion. Nat. Phys. 10 (10), 758–761.CrossRefGoogle Scholar
Gazzola, M., Hejazialhosseini, B. & Koumoutsakos, P. 2014 b Reinforcement learning and wavelet adapted vortex methods for simulations of self-propelled swimmers. SIAM J. Sci. Comput. 36 (3), B622–B639.CrossRefGoogle Scholar
Gellman, E.D., Tandler, T.R. & Ellerby, D.J. 2019 Swimming from coast to coast: a novel fixed-gear swimming gait in fish. Biol. Lett. 15 (6), 20190270.CrossRefGoogle Scholar
Gupta, S., Thekkethil, N., Agrawal, A., Hourigan, K., Thompson, M.C. & Sharma, A. 2021 Body-caudal fin fish-inspired self-propulsion study on burst-and-coast and continuous swimming of a hydrofoil model. Phys. Fluids 33 (9), 091905.CrossRefGoogle Scholar
Hausknecht, M. & Stone, P. 2015 Deep recurrent Q-learning for partially observable MDPs. In 2015 AAAI Fall Symposium, No. 6: Sequential Decision Making for Intelligent Agents, pp. 29–37. AAAI.Google Scholar
Huang, Q.X., Tian, F.-B., Young, J. & Lai, J.C.S. 2021 Transition to chaos in a two-sided collapsible channel flow. J. Fluid Mech. 926, A15.CrossRefGoogle Scholar
Huang, W.-X. & Tian, F.-B. 2019 Recent trends and progress in the immersed boundary method. Proc. Inst. Mech. Engrs C: J. Mech. Engng Sci. 233 (23–24), 7617–7636.Google Scholar
Jeong, Y.D., Kim, M.J. & Lee, J.H. 2023 Intermittent swimming of two self-propelled flexible fins with laterally constrained heaving motions in a side-by-side configuration. J. Fluid Mech. 960, A39.CrossRefGoogle Scholar
Kang, L.L., Gong, S.X., Lu, X.-Y., Cui, W.C. & Fan, D.X. 2023 Scaling laws for the intermittent swimming performance of a flexible plate at low Reynolds number. J. Hydrodyn. 35 (4), 803–810.CrossRefGoogle Scholar
Kang, L.L., Lu, X.-Y. & Cui, W.C. 2022 Intermittent swimming of two self-propelled flapping plates in tandem configuration. Phys. Fluids 34 (1), 011905.CrossRefGoogle Scholar
Krüger, T., Kusumaatmaja, H., Kuzmin, A., Shardt, O., Silva, G. & Viggen, E.M. 2017 The Lattice Boltzmann Method. Springer.CrossRefGoogle Scholar
Lallemand, P. & Luo, L.S. 2000 Theory of the lattice Boltzmann method: dispersion, dissipation, isotropy, Galilean invariance, and stability. Phys. Rev. E 61 (6), 6546–6562.CrossRefGoogle ScholarPubMed
van Leeuwen, J.L., Voesenek, C.J. & Müller, U.K. 2015 How body torque and Strouhal number change with swimming speed and developmental stage in larval zebrafish. J. Royal Soc. Interface 12 (110), 20150479.CrossRefGoogle ScholarPubMed
Li, G., Ashraf, I., François, B., Kolomenskiy, D., Lechenault, F., Godoy-Diana, R. & Thiria, B. 2021 Burst-and-coast swimmers optimize gait by adapting unique intrinsic cycle. Commun. Biol. 4 (1), 40.CrossRefGoogle ScholarPubMed
Li, G., Kolomenskiy, D., Liu, H., Godoy-Diana, R. & Thiria, B. 2023 Intermittent versus continuous swimming: an optimization tale. Phys. Rev. Fluids 8 (1), 013101.CrossRefGoogle Scholar
Lighthill, M.J. 1971 Large-amplitude elongated-body theory of fish locomotion. Proc. R. Soc. Lon. B 179 (1055), 125–138.Google Scholar
Liu, K., Huang, H.B. & Lu, X.-Y. 2020 Hydrodynamic benefits of intermittent locomotion of a self-propelled flapping plate. Phys. Rev. E 102 (5), 053106.CrossRefGoogle ScholarPubMed
Liu, K., Liu, X.C. & Huang, H.B. 2022 Scaling the self-propulsive performance of pitching and heaving flexible plates. J. Fluid Mech. 936, A9.CrossRefGoogle Scholar
Ma, J.T., Wang, Z., Young, J., Lai, J.C.S., Sui, Y. & Tian, F.-B. 2020 An immersed boundary–lattice Boltzmann method for fluid–structure interaction problems involving viscoelastic fluids and complex geometries. J. Comput. Phys. 415, 109487.CrossRefGoogle Scholar
Mandralis, I., Weber, P., Novati, G. & Koumoutsakos, P. 2021 Learning swimming escape patterns for larval fish under energy constraints. Phys. Rev. Fluids 6 (9), 093101.CrossRefGoogle Scholar
McElligott, M.B. & O’Malley, D.M. 2005 Prey tracking by larval zebrafish: axial kinematics and visual control. Brain Behav. Evol. 66 (3), 177–196.CrossRefGoogle ScholarPubMed
McHenry, M.J. & Lauder, G.V. 2005 The mechanical scaling of coasting in zebrafish (Danio rerio). J. Exp. Biol. 208 (12), 2289–2301.CrossRefGoogle ScholarPubMed
Mittal, R. & Iaccarino, G. 2005 Immersed boundary methods. Annu. Rev. Fluid Mech. 37 (1), 239–261.CrossRefGoogle Scholar
Mnih, V., et al. 2015 Human-level control through deep reinforcement learning. Nature 518 (7540), 529–533.CrossRefGoogle ScholarPubMed
Mogdans, J. 2019 Sensory ecology of the fish lateral-line system: morphological and physiological adaptations for the perception of hydrodynamic stimuli. J. Fish Biol. 95 (1), 53–72.CrossRefGoogle ScholarPubMed
Müller, U.K., Stamhuis, E.J. & Videler, J.J. 2000 Hydrodynamics of unsteady fish swimming and the effects of body size: comparing the flow fields of fish larvae and adults. J. Exp. Biol. 203 (2), 193–206.CrossRefGoogle ScholarPubMed
Müller, U.K. & Van Leeuwen, J.L. 2004 Swimming of larval zebrafish: ontogeny of body waves and implications for locomotory development. J. Exp. Biol. 207 (5), 853–868.CrossRefGoogle ScholarPubMed
Noda, T., Fujioka, K., Fukuda, H., Mitamura, H., Ichikawa, K. & Arai, N. 2016 The influence of body size on the intermittent locomotion of a pelagic schooling fish. Proc. R. Biol. Sci. 283 (1832), 20153019.Google ScholarPubMed
Novati, G., Verma, S., Alexeev, D., Rossinelli, D., Van Rees, W.M. & Koumoutsakos, P. 2017 Synchronisation through learning for two self-propelled swimmers. Bioinspir. Biomim. 12 (3), 036001.CrossRefGoogle ScholarPubMed
Quinn, D.B., Moored, K.W., Dewey, P.A. & Smits, A.J. 2014 Unsteady propulsion near a solid boundary. J. Fluid Mech. 742, 152–170.CrossRefGoogle Scholar
Ren, K., Yu, J.C., Li, H.B. & Feng, H. 2022 Numerical investigation on the swimming mode and stable spacing with two self-propelled fish arranged in tandem. Ocean Engng 259, 111861.CrossRefGoogle Scholar
Sotiropoulos, F. & Yang, X.L. 2014 Immersed boundary methods for simulating fluid–structure interaction. Prog. Aeronaut. Sci. 65, 1–21.CrossRefGoogle Scholar
Teyke, T. 1985 Collision with and avoidance of obstacles by blind cave fish Anoptichthys jordani (Characidae). J. Compar Physiol. A 157 (6), 837–843.CrossRefGoogle ScholarPubMed
Tian, F.-B. 2014 FSI modeling with the DSD/SST method for the fluid and finite difference method for the structure. Comput. Mech. 54 (2), 581–589.CrossRefGoogle Scholar
Tian, F.-B. 2015 A numerical study of linear and nonlinear kinematic models in fish swimming with the DSD/SST method. Comput. Mech. 55 (3), 469–477.CrossRefGoogle Scholar
Tian, F.-B., Bharti, R.P. & Xu, Y.Q. 2014 Deforming-spatial-domain/stabilized space–time (DSD/SST) method in computation of non-Newtonian fluid flow and heat transfer with moving boundaries. Comput. Mech. 53 (2), 257–271.CrossRefGoogle Scholar
Tian, F.-B., Luo, H.X., Zhu, L.D., Liao, J.C. & Lu, X.-Y. 2011 An efficient immersed boundary–lattice Boltzmann method for the hydrodynamic interaction of elastic filaments. J. Comput. Phys. 230 (19), 7266–7283.CrossRefGoogle ScholarPubMed
Tian, F.-B., Wang, Y., Young, J. & Lai, J.C.S. 2015 An FSI solution technique based on the DSD/SST method and its applications. Math. Models Meth. Appl. Sci. 25 (12), 2257–2285.CrossRefGoogle Scholar
Verma, S., Novati, G. & Koumoutsakos, P. 2018 Efficient collective swimming by harnessing vortices through deep reinforcement learning. Proc. Natl Acad. Sci. USA 115 (23), 5849–5854.CrossRefGoogle ScholarPubMed
Videler, J.J. & Weihs, D. 1982 Energetic advantages of burst-and-coast swimming of fish at high speeds. J. Exp. Biol. 97 (1), 169–178.CrossRefGoogle ScholarPubMed
Vignon, C., Rabault, J. & Vinuesa, R. 2023 Recent advances in applying deep reinforcement learning for flow control: perspectives and future directions. Phys. Fluids 35 (3), 031301.CrossRefGoogle Scholar
Wang, W.J., Escobedo, R., Sanchez, S., Han, Z.G., Sire, C. & Theraulaz, G. 2024 a Collective phases and long-term dynamics in a fish school model with burst-and-coast swimming. bioRxiv:595998.CrossRefGoogle Scholar
Wang, Z.P., Lin, R.J., Zhao, Z.Y., Chen, X., Guo, P.M., Yang, N., Wang, Z.C. & Fan, D.X. 2024 b Learn to flap: foil non-parametric path planning via deep reinforcement learning. J. Fluid Mech. 984, A9.CrossRefGoogle Scholar
Webb, P.W. 1971 The swimming energetics of trout: I. Thrust and power output at cruising speeds. J. Exp. Biol. 55 (2), 489–520.CrossRefGoogle Scholar
Weihs, D. 1974 Energetic advantages of burst swimming of fish. J. Theor. Biol. 48 (1), 215–229.CrossRefGoogle ScholarPubMed
Windsor, S.P., Tan, D. & Montgomery, J.C. 2008 Swimming kinematics and hydrodynamic imaging in the blind Mexican cave fish (Astyanax fasciatus). J. Exp. Biol. 211 (18), 2950–2959.CrossRefGoogle ScholarPubMed
Wu, G.H., Yang, Y. & Zeng, L.J. 2007 Kinematics, hydrodynamics and energetic advantages of burst-and-coast swimming of koi carps (Cyprinus carpio koi). J. Exp. Biol. 210 (12), 2181–2191.CrossRefGoogle ScholarPubMed
Xu, L.C., Tian, F.-B., Young, J. & Lai, J.C.S. 2018 A novel geometry-adaptive Cartesian grid based immersed boundary–lattice Boltzmann method for fluid–structure interactions at moderate and high Reynolds numbers. J. Comput. Phys. 375, 22–56.CrossRefGoogle Scholar
Xu, L.C., Wang, L., Tian, F.-B., Young, J. & Lai, J.C.S. 2019 A geometry-adaptive immersed boundary–lattice Boltzmann method for modelling fluid–structure interaction problems. In IUTAM Symposium on Recent Advances in Moving Boundary Problems in Mechanics (ed. S. Gutschmidt, J. Hewett, and M. Sellier), pp. 161–171. Springer.CrossRefGoogle Scholar
Xu, Y.Q., Tang, X.Y., Tian, F.-B., Peng, Y.H., Xu, Y. & Zeng, Y.J. 2014 IB–LBM simulation of the haemocyte dynamics in a stenotic capillary. Comput. Meth. Biomech. Biomed. Engng 17 (9), 978–985.Google Scholar
Xue, J.Q., Han, F., van Oorschot, B.K., Clifton, G. & Fan, D.X. 2023 Exploring storm petrel pattering and sea-anchoring using deep reinforcement learning. Bioinspir. Biomim. 18 (6), 066016.CrossRefGoogle ScholarPubMed
Yan, L., Chang, X.H., Wang, N.H., Tian, R.Y., Zhang, L.P. & Liu, W. 2021 Learning how to avoid obstacles: a numerical investigation for maneuvering of self-propelled fish based on deep reinforcement learning. Intl J. Numer. Meth. Fluids 93 (10), 3073–3091.CrossRefGoogle Scholar
Yan, L.Y., Chang, X.H., Tian, R.Y., Wang, N.H., Zhang, L.P. & Liu, W. 2020 A numerical simulation method for bionic fish self-propelled swimming under control based on deep reinforcement learning. Proc. Inst. Mech. Engrs C: J. Mech. Engng Sci. 234 (17), 3397–3415.Google Scholar
Yao, H.Z., Xu, X., Zhou, Y. & Xu, C. 2018 Impacts of isopyrazam exposure on the development of early-life zebrafish (Danio rerio). Environ. Sci. Pollut. Res. 25 (24), 23799–23808.CrossRefGoogle ScholarPubMed
Young, J., Tian, F.-B., Liu, Z.L., Lai, J.C.S., Nadim, N. & Lucey, A.D. 2020 Analysis of unsteady flow effects on the Betz limit for flapping foil power generation. J. Fluid Mech. 902, A30.CrossRefGoogle Scholar
Yu, H.Y., Liu, B., Wang, C.Y., Liu, X.C., Lu, X.-Y. & Huang, H.B. 2022 Deep-reinforcement-learning-based self-organization of freely undulatory swimmers. Phys. Rev. E 105 (4), 045105.CrossRefGoogle ScholarPubMed
Zhu, Y. & Pang, J.H. 2023 A numerical simulation of target-directed swimming for a three-link bionic fish with deep reinforcement learning. Proc. Inst. Mech. Engrs C: J. Mech. Engng Sci. 237 (11), 2450–2460.Google Scholar
Zhu, Y., Pan, J.H. & Tian, F.-B. 2022 a Stable schooling formations emerge from the combined effect of the active control and passive self-organization. Fluids 7 (1), 41.CrossRefGoogle Scholar
Zhu, Y., Pang, J.H., Gao, T. & Tian, F.-B. 2022 b Learning to school in dense configurations with multi-agent deep reinforcement learning. Bioinspir. Biomim. 18 (1), 015003.CrossRefGoogle ScholarPubMed
Zhu, Y., Pang, J.H. & Tian, F.-B. 2022 c Point-to-point navigation of a fish-like swimmer in a vortical flow with deep reinforcement learning. Front. Phys. 10, 870273.CrossRefGoogle Scholar
Zhu, Y., Tian, F.-B., Young, J., Liao, J.C. & Lai, J.C.S. 2021 A numerical study of fish adaption behaviors in complex environments with a deep reinforcement learning and immersed boundary–lattice Boltzmann method. Sci. Rep. 11 (1), 1–20.Google ScholarPubMed
Zhu et al. supplementary material 1
Zhu et al. supplementary material
File
13.4 KB
Zhu et al. supplementary material movie 2
Zhu et al. supplementary material movie
File
3.1 MB
Zhu et al. supplementary material movie 3
Zhu et al. supplementary material movie
File
3.1 MB
Zhu et al. supplementary material movie 4
Zhu et al. supplementary material movie
File
2.1 MB
Zhu et al. supplementary material movie 5
Zhu et al. supplementary material movie
File
1.8 MB
Zhu et al. supplementary material movie 6
Zhu et al. supplementary material movie
File
1.6 MB