mtcore::RuneIterator< char16_t > Struct Reference

Iterates over runes of utf16 sequences Also handles flipping endianness to native endian. More...

#include <byte_endian.hpp>

Inheritance diagram for mtcore::RuneIterator< char16_t >:

Collaboration diagram for mtcore::RuneIterator< char16_t >:

Public Types
using	IterElem = char32_t
using	IterElem

Public Member Functions
Optional< char32_t >	next ()
Optional< Rune >	next ()
	Gets the next Rune, if present.

Public Attributes
Slice< const char16_t >	data
size_t	strIndex = 0
bool	reverseBom = false
Slice< const char16_t >	data
size_t	strIndex

Detailed Description

Iterates over runes of utf16 sequences Also handles flipping endianness to native endian.

Definition at line 939 of file byte_endian.hpp.

Member Typedef Documentation

IterElem [1/2]

using mtcore::RuneIterator< char16_t >::IterElem

Definition at line 873 of file byte_endian.hpp.

IterElem [2/2]

using mtcore::RuneIterator< char16_t >::IterElem = char32_t

Definition at line 940 of file byte_endian.hpp.

Member Function Documentation

next() [1/2]

Optional< Rune > mtcore::RuneIterator< char16_t >::next ( )

inline

Gets the next Rune, if present.

Definition at line 878 of file byte_endian.hpp.

                          {
      if (strIndex >= data.size()) {
        return nullopt;
      }
      auto curIndex        = strIndex;
      char32_t currentRune = 0;
      auto numBytes        = impl::unicode::num_bytes(data[curIndex]);
 
      if (numBytes < 0) {
        ++strIndex;
      }
      else if (curIndex + numBytes - 1 >= data.size()) {
        strIndex = data.size();
      }
      else {
        strIndex = curIndex + numBytes;
        for (size_t index = curIndex; index < strIndex; ++index) {
          auto flag = impl::unicode::get_flag(data[index]);
          if (index > curIndex && flag != impl::unicode::continueFlag) {
            strIndex    = curIndex + index - 1;
            currentRune = 0;
            break;
          }
          auto noFlag = impl::unicode::without_flag(data[index]);
          currentRune <<= 6;
          currentRune |= noFlag;
        }
      }
      return currentRune;
    }

next() [2/2]

Optional< char32_t > mtcore::RuneIterator< char16_t >::next ( )

inline

Definition at line 945 of file byte_endian.hpp.

                              {
      if (strIndex >= data.size()) {
        return nullopt;
      }
      size_t curIndex      = strIndex;
      char32_t currentRune = 0;
 
      auto ch = data[curIndex];
      if (reverseBom) {
        ch = flip_endian_ch16(ch);
      }
 
      if (is_high_surrogate(ch)) {
        if (curIndex + 1 >= data.size()) {
          strIndex = data.size();
          return currentRune;
        }
        else {
          auto chNext = data[curIndex + 1];
          if (reverseBom) {
            chNext = flip_endian_ch16(chNext);
          }
 
          const auto high = (ch - impl::unicode::utf16HighOffset) * 0x400;
          const auto low  = chNext - impl::unicode::utf16LowOffset;
          currentRune     = high + low + impl::unicode::utf16Sub;
          strIndex        = curIndex + 2;
        }
      }
      else {
        if (!is_low_surrogate(ch)) {
          currentRune = static_cast<char32_t>(ch);
          if (reverseBom) {
            flip_endian_ch16(currentRune);
          }
        }
        ++strIndex;
      }
      return currentRune;
    }

Here is the call graph for this function:

Member Data Documentation

data [1/2]

Slice<const char16_t> mtcore::RuneIterator< char16_t >::data

Definition at line 874 of file byte_endian.hpp.

data [2/2]

Slice<const char16_t> mtcore::RuneIterator< char16_t >::data

Definition at line 941 of file byte_endian.hpp.

reverseBom

bool mtcore::RuneIterator< char16_t >::reverseBom = false

Definition at line 943 of file byte_endian.hpp.

strIndex [1/2]

size_t mtcore::RuneIterator< char16_t >::strIndex

Definition at line 875 of file byte_endian.hpp.

strIndex [2/2]

size_t mtcore::RuneIterator< char16_t >::strIndex = 0

Definition at line 942 of file byte_endian.hpp.

---

The documentation for this struct was generated from the following file:

• byte_endian.hpp