I already knew that Vertex AI is a new product of GCP so it tends to be unstable. But I didn’t imagine it lacks a vital function: log errors or exceptions thrown by python code.After I added code fromthis article, some of my steps, fortunately, reported error logs. But for some other steps, they jump out with just a simple message:You may think I could find more detail in the URL it gives at the end. But that’s not true. After I copy and jump to that URL. It showed nothing:Don’t be confused. The blank above is from the GUI of GCP because there is no record.If a pipeline frame ...继续阅读 (91)

Building a library for research and experiments is quite different from building other types of software.A key challenge is that, in research, abstractions and APIs are rarely set in stone:users may want to propose a slight variant or modification to literallyANYWHEREin the whole program,just because they have a new idea.In deep learning libraries, these variants can be a different implementation of a layer,a change in optimization algorithm, or a small modification to the training logic, etc.When users want to make such changes, they often implement variants by simply adding featuresto the ta ...继续阅读 (39)

Two days ago we met a weird error when running aselectthrough BigQuery Python API:Error : google.api_core.exceptions.BadRequest: 400 Bad int64 value: BA1DI checked theselectSQL but it doesn’t contain any type like “int64”.After “binary search” in the SQL code, I finally found out that the SQL is actually querying a “view” and the code of this view is like:SELECT cast(col1, int64) AS COL1, cast(col2, int64) AS COL2, FROM table1The correct solution is to change “cast” to “safe_cast”.Here is the lesson for me: some errors may ...继续阅读 (85)

New York is three hours ahead of California,But that doesn’t make California slow.Someone graduated at the age of 22,But waited five years before securing a good job.Some became a CEO at 25,And died at 50.While another became a CEO at 50,And lived to 90 years.Someone is still single,While someone else got married.Obama retired at 55,& Trump started at 70.Everyone in this world works based on their time zone.People around you might seem to be ahead of you,& some might seem to be behind you.But everyone is running their own race, in their own time.Do not envy them & do not mock them.They are in ...继续阅读 (62)

Let's take a look at how to use AbortController to cancel Ajax requests. But, is canceling requests really useful? To cancel or not to cancel, that is the question. ...继续阅读 (43)

TortoiseGit is OK but GitExtensions failsGitExtensions and Git fail:"git" pull --progress "origin" git@github.com: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. Done Press Enter or Esc to exit...But TortoiseGit is OK.git.exe pull --progress -v --no-rebase "origin" From github.com:jinq0123/recastnavigation = [up to date] master -> origin/master = [up to date] release-2.0 -> origin/release-2.0 Already up to date.ssh -Tshows that the reason is there is no id files:PS d:\git ...继续阅读 (20)

For me, it’s easy to fall into a state of working all day, being busy all day but not knowing what I’m busy with, leading to anxiety the next day, not knowing what to say at the morning meeting, and only being able to do things that make me feel like I can talk. Why introduce the Pomodoro Technique: To solve this problem, I thought of many methods, such as writing a TODO list every day, but I still wasted a lot of time due to various interruptions, which made it impossible for me to complete the tasks in my original TODO list. ...继续阅读 (39)

前言 大家在写Go的时候，初期应该都会遇到过下面的编译报错： xx declared but not used 比如下面的代码示例： 1 2 3 4 5 6 7 // example2.go package main func main() { a := 10 a = 1 } 执行go build ...继续阅读 (8)

This should be the real first explanation for customizing the TyranoScript kernel. TyranoScript is a domain-specific language, but it runs in the browser, so its functionality is definitely implem... ...继续阅读 (42)

The Ruby programming language has the notion of aHash. AHashis a dictionary-like collection of unique keys and their values. Ruby hashes have most of the semantics of an ES6Map, but also have the syntactic conveniences of Plain-Old-JavaScript-Objects (“POJOs”).Interestingly, Ruby hashes also have the notion of programmatically determine a default value to be returned when accessing keys that have not been set. In JavaScript, the default value is alwaysundefined.In this essay we will look at rolling our ownHashclass with Ruby-like semantics, and then we’ll examine one of the most interesting th ...继续阅读 (39)

The Ruby programming language has the notion of aHash. AHashis a dictionary-like collection of unique keys and their values. Ruby hashes have most of the semantics of an ES6Map, but also have the syntactic conveniences of Plain-Old-JavaScript-Objects (“POJOs”).Interestingly, Ruby hashes also have the notion of programmatically determine a default value to be returned when accessing keys that have not been set. In JavaScript, the default value is alwaysundefined.In this essay we will look at rolling our ownHashclass with Ruby-like semantics, and then we’ll examine one of the most interesting th ...继续阅读 (26)

The first few hundred registrations received a mug.As a machine learning practitioner in the Los Angeles area, I was ecstatic to learn thatNIPS 2017would be inLong Beachthis year. The conference sold out in a day or two. The conference was held at theLong Beach Convention Center (and Performing Arts Center), very close to theAquarium of the Pacificand about a mile from theQueen Mary. The venue itself was beautiful, and probably the nicest place I’ve ever attended a conference. It’s also the most expensive place I’ve ever had a conference. $5 for a bottle of Coke? $11 for two ...继续阅读 (22)

NOTE 1:This is part 1 in a series that will probably contain 3 or 4 parts. Then I will return to the usual data science etc. posts.NOTE 2:This post was intentionally delayed until I received final approval on the submission of my final dissertation.On March 14, I passed my final oral defense for my Ph.D. in Statistics.It was the moment I had been waiting for. The moment I dreaded for so many years and the moment that I thought would never come. I had very few days and times to choose from. It came down to the 13th (bad luck?) and the 14th (Pi Day). My defense began at 10am and was supposed to ...继续阅读 (32)

People are become，keep a promise，but hold a single fickle heart．——人是会变的，守住一个不变的承诺，却守不住一颗善变的心。 ...继续阅读 (10)

There are two foundational technology changes rolling through the car industry at the moment; electric and autonomy. Electric is happening right now, largely as a consequence of falling battery prices, while autonomy, or at least full autonomy, is a bit further off - perhaps 5-10 years, depending on how fast some pretty hard computer science problems get solved. Both of these will cycle into essentially the entire global stock of (today) around 1.1bn cars over a period of decades, subject to all sorts of variables, and both of them completely remake the car industry and its suppliers, as well ...继续阅读 (25)

This autumn Apple will release a new iPhone design, and the fact that it postponed a new design and kept the 6 design for three years instead of two suggests it has something that will attract attention. However, it will really still ‘just’ be another iPhone. Meanwhile, we have some indications that Apple is working on AR glasses (of which more later) and certainly was working on a car project - but neither of these is likely to see a mass-market consumer release for a year or two at the least (cars perhaps longer). So, expect a lot more 'innovation dead at Apple!’ stories.Th ...继续阅读 (30)

nodejs.TypeError: You may only yield a function, promise, generator, a rray, or object, but the following object was passed: "undefined这是什么error ...继续阅读 (17)

HTC is getting 2017 off to a flying start with an unseasonably early announcement of its next flagship phone: the U Ultra. This 5.7-inch device inaugurates a new U series of smartphones and is joined by a smaller and lesser U Play, which scales things down to 5.2 inches and a humbler camera and processor spec. HTC is touting a new Sense Companion, which is its take on the growing trend for putting AI assistants into phones, plus the addition of a second screen at the top of the U Ultra. As with Apple’s latestiPhones, Lenovo’sMoto Z, and theHTC Bolt, neither of HTC’s new handsets has a headphon ...继续阅读 (25)

I’ve never been very big on New Year’s resolutions. I’ve tried them in the past, and while they are nice to think about, they are always overly vague, difficult to accomplish in a year, trite, or just don’t get done (or attempted). This year I decided to try something different instead of justnotmaking resolutions at all. I set out some professional goals for myself as a Data Scientist. So without further ado…1.Don’t Complain about It, Fix It:Contribute to Open Source Software (More)Open source software is only as good as its community and/or developer(s). D ...继续阅读 (37)

As has become my practice, I will end the year (today) looking back and start the year (tomorrow) looking forward.As a starting point for looking back on 2016, we can start with myWhat Is Going To Happen In 2016 postfrom Jan 1st 2016.I thought AR/VR and wearables would disappoint in 2016. They did. As my friendSunilpoints out, thebiggest thing in AR/VR in 2016 was Pokemon Go:Easy to build content (apps) on a cheap widespread hardware platform (smartphones) beat out sophisticated and high resolution content on purpose built expensive hardware (content on VR headsets). We re-learned an old lesso ...继续阅读 (23)

To actually doubt a product is not at all bad. This is me; I simply don’t just hit the buy button right away, most especially if it is a health-related product, but I don’t endless research to finally give it a nod or don’t buy it. Recently, I accidentally found this ebook online as I was searching for sleep apnea. What struck me most is the 60-day warranty, so with this, if I don’t like the content, my money can be returned plus I can get the ebook.Nevertheless, it took me a while to finally decide to buy it, but I did purchase it anyhow.The Miracle Cureis a good purchase for me after all, no ...继续阅读 (17)

Python Assert 为何不尽如人意Python中的断言用起来非常简单，你可以在assert后面跟上任意判断条件，如果断言失败则会抛出异常。>>> assert 1 + 1 == 2 >>> assert isinstance('Hello', str) >>> assert isinstance('Hello', int) Traceback (most recent call last): File "<input>", line 1, in <module> AssertionError其实assert看上去不错，然而用起来并不爽。就比如有人告诉你程序错了，但是不告诉哪里错了。很多时候这样的assert还不如不写，写了我就想骂娘。直接抛一个异常来得更痛快一些。改进方案 #1一个稍微改进一丢丢的方案就是把必要的信息也放到assert语句后面，比如这样。>>> s = "nothin is impossible." >>> key = "nothing" >>> assert key in s, "Key: '{}' is not in Target: '{}'".format(key, s) Traceback (most recen ...继续阅读 (29)

今天 Google 发布了将近半年前吹的牛逼 Google Allo我们都很 Excited 但是登陆之后分分钟觉得没什么卵用，下面我们来说一说这些没有卵用的功能（贴纸什么的就不提了），一个有用的，一个没用的。智能回复这个功能是为懒人准备的，Allo 通过深度学习掌握了你的语言习惯，然后可以在朋友发来信息的时候，分析出几种回答，你点一下就可以选出自己的回答。看起来很酷，但是本质上是在科技炫技，朋友发来一张照片，你选一下 Excited，对话结束。这个功能让沟通变的索然无味，全是套路。智能助理其实最近一直在想一个问题，就是 Bot 这种方式到底适合什么样子的内容交互。Google Allo 里的 Assistant 提供了几种服务，搜视频，搜图片，搜地点，搜酒店，搜路线。But，这些真的适合在这里吗？我并不认为，我认为 Bot 适合被动性的内容获取，像通知，或者让他到全网上帮你盯着什么东西的动态。But，Allo 在这点上作出了一点新套路，因为 Google 拥有大量你的个人数据，例如相册，Gmail，日历，所以当你和 Google Assistant 聊天的时候，你能感受到他确实是你的管家，对你了如指掌。你可以问他我相册里有猫的照片，问他我的快递到哪了，而对于一些其他的问题，他也可以给出比较精确的回答。比较有趣的是，他可以针对问题猜测一些相关问题，例如你问了一天，那么他会提示一天有 ...继续阅读 (24)

这几年工作下来，越来越体会到communication的重要性，无论是从技术层面还是工程组织层面。在这方面的投入，对工作效率、产品质量等等方面都会有很好的加强。尤其是我们岂安的技术团队从开始就处于人力匮乏的状态，又同时要覆盖SAAS和私有化大数据解决方案两条迥然不同的研发线路，矛盾比较突出。所以，从开始的时候就想着去建立一套自己的通讯基础设施，来满足不同业务场景下的各种需求，于是催生了这朵RPC领域的奇葩。冠名以babel，纯属个人在初始阶段的勃勃雄心，希望能尽可能的消弭不同系统组件间的通讯细节，让我们这帮三流的程序员也能做出二流的系统：要解决python和java的问题，各语言对等。我们的系统有大量跨语言的交互，需要尽量减少通讯开销。这个是RPC的基本功。要能简单的管理和监控。这个是RPC良好运维，进化到service层面所需要的。最好还能兼顾离线数据分析过程中的数据组织功能。以数据为核心的公司这点其实很重要。可以兼顾大规模集群环境和小集群环境（甚至是单机）。要解决跨数据中心的问题。风控SAAS有SLA方面的变态需求，需要部署到客户最后100米处，这也是刚需。不光是通信，还要能做好持久化、负载均衡、动态伸缩等等其他功能，这个是衡量分布式系统成功与否的重要指标。轻。本文后续部分会先在技术背景方面闲聊一会，讲讲为啥要造轮子；然后会介绍一下我们这个简单又独特的RPC的实现部分，以及在我 ...继续阅读 (34)

代码：app.use(multer({ dest:’./tmp’, rename:function(fieldname,filename){ return filename; } })); ...继续阅读 (36)