java - Converting string to UTF-8 using buffer -


i need convert (possibly large) string utf-8, don't want create byte array containing full encoding. idea use charsetencoder this, charsetencoder acts on charbuffer, means supplemental characters (outside unicode range 0x0000 0xffff) should considered.

now method was using charbuffer.wrap(string.substring(start, start + block_size)), , bytebuffer created using bytebuffer.allocate((int) math.ceil(encoder.maxbytesperchar() * block_size)). however, charbuffer contain block_size code points, not code units (characters); think actual amount of characters 2 times block_size maximum. means bytebuffer 2 times small well.

how can calculate correct amount of bytes bytebuffer? double in case each , every character supplemental character, seems bit much. other reasonable option seems iterate on code units (characters) or code points, @ least looks suboptimal.

any hints on what's efficient approach encode strings piecemeal? should use buffer, iteration string.codepointat(location), or there encoding routine directly handles code points?

additional requirement: invalid character encodings should result in exception, default substitution or skipping of invalid characters cannot allowed.

it seems easier wrap whole string, , blindly read characters until none remaining. no need cut string in parts, encoder read bytes until output buffer filled up:

final charsetencoder encoder = standardcharsets.utf_8.newencoder(); final charbuffer buffer = charbuffer.wrap(input); final bytebuffer encodedbuffer = bytebuffer.allocate(buffer_size); coderresult coderresult;  while (buffer.hasremaining()) {     coderresult = encoder.encode(buffer, encodedbuffer, false);     if (coderresult.iserror()) {         throw new illegalargumentexception(                 "invalid code point in input string");     }     encodedbuffer.flip();     // stuff encodedbuffer     encodedbuffer.clear(); }  // required encoder: call encode true indicate end coderresult = encoder.encode(buffer, encodedbuffer, true); if (coderresult.iserror()) {     throw new illegalargumentexception(             "invalid code point in input string"); } encodedbuffer.flip(); // stuff encodedbuffer encodedbuffer.clear(); // if still required

Comments

Post a Comment

Popular posts from this blog

commonjs - How to write a typescript definition file for a node module that exports a function? -

consider, toml node module can use: // toml.d.ts declare module toml { export function parse(value:string):any; } declare module "toml" { export = toml; } then: /// <reference path="../../../../../defs/toml/toml.d.ts"/> import toml = require('toml'); toml.parse(...); however, node module export single function, such 'glob' ( https://github.com/isaacs/node-glob ). the node usage of module be: var glob = require("glob") glob("*.js", {}, callback(err, files) { ... }); you'd naively expect this: // glob.d.ts declare function globs(paths:string, options:any, callback:{(err:any, files:string[]):void; ...but because typescripts 'import' semantics bit strange, seems can use 'import .. = require()' statement alias modules . trying call: /// <reference path="../../../../../defs/glob/glob.d.ts"/> import blog = require('glob'); results in: error ts2072: mod...
Read more

openid - Okta: Failed to get authorization code through API call -

i'm integrating okta own idp server using okta's api. i'm implementing authorization code flow following steps below: in own server, use /api/v1/authn endpoint sessiontoken. use sessiontoken obtain authorization calling endpoint: /oauth2/v1/authorize?client_id=" + clientid + "&sessiontoken=" + sessiontoken + "&response_type=code&response_mode=query&scope=openid&redirect_uri=" + redirecturl + "&state=evanyang&nonce=" it's supposed return response status code 302 , location header containing redirect url code value. however, keep getting response status code 200 , without location header, html body saying "you using unsupported browser." , "javascript disabled on browser." according api documentation: http://developer.okta.com/docs/api/resources/oidc.html#authentication-request , sessiontoken parameter sufficient this: an okta one-time sessiontoken. allows api-based ...
Read more

ios - Change Storyboard View using Seague -

i have following code checks connection server, , depending on want change views if no connection found. nsstring *connect = [nsstring stringwithcontentsofurl:[nsurl urlwithstring:@"http://myserver.com"] encoding:nsutf8stringencoding error:nil]; if (connect == null) { [self performseguewithidentifier:@"network_failure" sender:self]; } else { // other code here } my problem not change views. have added storyboard segue between 2 views identifier of network_failure . not have navigation controller or that, problem? thanks help! no not problem. first of all, in objectivec exists nil object oriented null . must use that. so: if(connect == nil) or better: if(!connect) so due fact nil not same of null , probably code does't enter in if scope . you have been able discover breakpoint. anyway: be sure set trigger segue (line) 2 view controller , , name network_failure (that not best name. should instead view1toview2 ) as, m...
Read more